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This  report  presents  methods  for  designing  and  analyzing  multirate  asynchronous 
digital  controls  for  linear  systems.  Multirate  digital  control  is  a  natural  approach 
for  systems  with  widely-spaced  natural  frequencies.  An  asynchronous  architecture 
provides  a  simple  approach  for  assigning  control  tasks  to  distributed  processors. 

Previous  multirate  design  methods  required  either  synchronized  samplers  or  high 
sample  rates.  Synchronized  samplers  produce  a  system  that  is  periodically  time 
varying.  Alternatively,  high  sample  rates  simulate  a  continuous  controller.  In  prac¬ 
tice,  synchronized  implementations  and  implementations  with  high  sample  rates 
may  have  liigher  cost,  complexity,  and  weight  and  lower  reliability  compared  to 
asynchronous  designs.  In  some  cases,  an  asynchronous  implementation  with  slow 
sampling  will  perform  as  well  as  a  fast,  synchronized  design.  The  goal  of  this  re¬ 
search  was  to  develop  methods  to  design  and  evaluate  asynchronous  control  systems 
operating  at  minimal  sample  rates. 

v  The  multirate  asynclironous  design  and  analysis  methods  developed  in  this  re¬ 
port  use  a  time-domain  approach  based  on  the  closed-loop  state  transition  matrix. 
Design  and  analysis  algorithms  (implemented  in  PC-MATLA3)  are  included  in  an 
Appendix.  The  analysis  is  based  on  a  sufficient  stability  criterion  which  gives  an 
objective  measure  of  long-term  stability  and  indicates  short-term  stability. 
sign  method  allows  the  designer  to  specify  the  form  of  the  controller.  Numerical 
optimization  is  U3ed  to  minimize  a  quadratic  cost  integral.  Design  and  analysis 
examples  are  presented  for  a  double  integrator  plant  and  a  two-link  robot  arm.  / 
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Abstract 


This  report  presents  methods  for  designing  and  analyzing  multirate  asynchronous 
digital  controls  for  linear  systems.  Multirate  digital  control  is  a  natural  approach 
for  systems  with  widely-spaced  natural  frequencies.  An  asynchronous  architecture 
provides  a  simple  approach  for  assigning  control  tasks  to  distributed  processors. 

Previous  multirate  design  methods  required  either  synchronized  samplers  or  high 
sample  rates.  Synchronized  samplers  produce  a  system  that  is  periodically  time 
varying.  Alternatively,  high  sample  rates  simulate  a  continuous  controller.  In  prac¬ 
tice,  synchronized  implementations  and  implementations  with  high  sample  rates 
may  have  higher  coat,  complexity,  and  weight  and  lower  reliability  compared  to 
asynchronous  designs.  In  some  cases,  an  asynchronous  implementation  with  slow 
sampling  will  perform  as  well  as  a  last,  synchronized  design.  The  goal  of  this  re¬ 
search  was  to  develop  methods  to  design  and  evaluate  asynchronous  control  systems 
operating  at  minimal  sample  rates. 

The  multirate  asynclironous  design  and  analysis  methods  developed  in  this  re¬ 
port  use  a  time-domain  approach  based  on  the  closed-loop  state  transition  matrix. 
Design  and  analysis  algorithms  (implemented  in  PC-MATLAB)  arc  included  in  an 
Appendix.  The  analysis  is  based  on  a  sufficient  stability  criterion  which  gives  an 
objective  measure  of  long-term  stability  and  indicates  short-term  stability.  The  de¬ 
sign  method  allows  the  designer  to  specify  the  form  of  the  controller.  Numerical 
optimization  is  used  to  minimize  a  quadratic  cost  intcgraL  Design  and  analysis 
examples  are  presented  for  a  double  integrator  plant  and  a  two-link  robot  arm. 
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Chapter  1 


Introduction 


1.1  Purpose 


The  purpose  of  this  research  was  to  develop  methods  to  design  and  analyze  asyn¬ 
chronous  digital  control  systems.  Digital  control  systems  can  provide  high  reliabil¬ 
ity  with  low  cost  and  weight  using  modern  digital  integrated  circuits.  Distributed 
system  architecture  can  also  reduce  cost  or  improve  fault  tolerance.  Also,  unsyn- 
chronized  distributed  systems  may  be  easier  to  build.  Consequently,  asynchronous 
digital  design  is  a  natural  approach  for  implementing  many  distributed  control  sys¬ 
tems. 

Synchronized  multirate  systems  are  a  special  case  of  the  asynchronous  digital 
system.  Synchronous  multirate  systems  are  periodically  time  varying  because  the 
sample  process  repeats  exactly  after  some  period.  Existing  multirate  design  ap¬ 
proaches  use  this  periodic  behavior  as  the  basis  for  design  and  analysis. 

With  true  asynchronous  systems,  the  ratio  of  sample  periods  is  irrational  and 
the  sampling  pattern  never  repeats  exactly.  However,  asynchronous  sample  patterns 
can  be  approximated  by  synchronous  patterns  just  as  irrational  numbers  can  be  ap¬ 
proximated  by  rational  fractions  to  any  desired  accuracy.  A  similar  approximation 
is  the  basis  of  the  asynchronous  design  method  developed  here. 
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Chapter  1.  Introduction 


1.2  Related  Literature 

The  asynchronous  discrete-time  control  problem  is  the  general  case  of-  the  syn¬ 
chronous  multirate  digital  control  problem.  Walton  [Wal81]  and  Glasson  [Gla83] 
developed  comprehensive  surveys  of  existing  multirate  methods.  Multirate  digi¬ 
tal  design  has  been  a  topic  of  continuing  interest  since  the  early  1950’s.  Existing 
multirate  methods  generally  fall  into  two  classes:  frequency  domain  methods  and 
time  domain  methods.  All  previous  methods  were  limited  to  synchronous  systems. 
Specifically,  all  sample  period  ratios  had  to  be  rational  numbers  such  that  the  sys¬ 
tem  was  periodically  time  varying. 

The  original  synchronous  frequency  domain  techniques  were  Frequency  Decom¬ 
position  of  Sklansky  [SR55]  and  Switch  Decomposition  of  Kranc  [Kra57].  Subse¬ 
quent  efforts  by  Coffey  and  Williams  [CW66],  Jury  [Jur€8]  [Jur67],  Boykin  and 
Frazier  [BF75],  and  Whitbeck  [WH78]  extended  and  expanded  the  Switch  and  Fre¬ 
quency  decomposition  techniques. 

Kalman  and  Bertram  [KB59]  described  a  general  state  space  analysis  technique 
for  hybrid  linear  systems.  This  technique  was  the  basis  for  several  optimal  control 
design  approaches.  Glasson  and  Broussard  [GB79]  [BH84]  [BG80] ,  Amit  and  Powell 
[AmiSO]  [AP81],  and  Lennartson  [Len86]  solved  the  optimal  synchronous  multirate 
state-feedback  regulator  problem.  Berg  and  Powell  [Ber86]  solved  the  more  general 
constrained  problem  for  a  controller  of  specified  form  (such  as  partial  state  feedback 
with  constant  gains). 

All  of  these  methods  required  synchronous  sampling  (rational  sample  period 
ratios). 


1.3  Overview 

This  report  addresses  two  related,  raultiratc  digital  control  topics.  First,  a  suf¬ 
ficient  stability  criterion  is  developed  for  asynchronous  multirate  linear  systems. 
Second,  a  new  synchronous  multirate  design  method  is  developed  and  extended  to 
asynchronous  systems. 


1.3.  Overview 
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The  analysis  approach  described  here  was  based  on  existing  synchronous  meth¬ 
ods  with  an  additional  allowance  to  account  for  the  difference  between  the  actual 
sample  pattern  and  a  synchronous  approximation.  The  resulting  stability  criterion 
is  a  sufficient  condition  that  can  guarantee  asynchronous  stability  (but  does  not 
prove  instability).  The  criterion  also  gives  a  figure  of  merit  analogous  to  a  right¬ 
most  s-plane  bound  for  the  poles  of  a  linear,  time-invariant  system.  This  author 
doubts  the  existence  of  a  necessary  and  sufficient  condition  for  true  asynchronous 
stability.  In  practice,  this  is  not  a  problem  because  the  synchronous  approximation 
can  be  arbitrarily  precise. 

The  design  approach  is  an  extension  of  the  Constrained  Optimization  Synthesis 
design  method  [Ber86j.  The  cost  and  gradient  formulations  are  new.  A  gradient 
search  finds  controller  coefficients  which  minimize  a  scalar  cost  function.  The  de¬ 
signer  specifies  the  controller  structure,  cost  weighting,  and  the  process  noise.  Then 
the  algorithm  finds  optimal  gains  that  minimize  the  weighted  mean  square  state  er¬ 
rors.  If  the  specified  process  noise  exceeds  the  synchronous  approximation  error  the 
resulting  design  should  be  stable  and  well  behaved. 

This  method  and  the  Constrained  Optimization  Synthesis  method  produce  iden¬ 
tical  results  given  the  same  synchronous  problem.  This  new  method  has  three 
advantages.  First,  this  method  avoids  numerical  overflow  and  manual  fine-tuning 
during  the  gradient  search.  Second,  generalized  forms  for  the  cost  and  process  noise 
accommodate  discrete  measurement  noise  and  saturation  penalties.  Finally,  this 
method  computes  the  gradients  and  Hessian  only  for  actual  feedback  gains  (instead 
of  all  possible  feedback  paths).  This  last  factor  gives  a  significant  reduction  in 
computation  time  and  data  storage. 

The  basic  design  method  finds  optimal  feedback  gains  for  synchronous  sam¬ 
pling  at  a  specified  phasing  (for  instance,  two  samplers  with  simultaneous  initial 
samples).  This  basic  method  is  extended  rigorously  to  synchronous  sampling  with 
random  phasing.  Without  rigorous  proof,  heuristic  arguments  arc  made  for  apply¬ 
ing  the  extended  method  to  the  true  asynchronous  sampling  case.  The  stability  of 
the  resulting  asynchronous  design  can  be  verified  with  the  asynchronous  stability 
->  :*erion,  and  the  performance  can  be  evaluated  by  simulation. 
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PC-MATLAB  [MLBK85]  computer  codes  were  developed  for  the  design  and 
analysis  methods.  These  codes  are  included  in  Appendix  E.  Sample  design  cases 
illustrate  the  methods  and  some  properties  of  asynchronous  systems. 


1.4  Scope  of  Methods 

The  design  and  analysis  methods  are  suitable  for  multi-input/multi-output  systems. 
The  formulation  does  not  distinguish  between  plant  and  controller  or  between  states, 
inputs,  or  controls.  The  methods  apply  to  linear  systems  composed  of: 

•  a  linear,  time-invariant  continuous-time  part  described  by  xc  —  Axc  +  Bu 
where  A  and  B  are  constant  matrices,  xc  is  the  continuous  state  vector,  and 
u  —  xs. 

•  sample-and-hold  elements  with  outputs  x,  described  by  a  finite  number  of 
state  transition  matrices  of  the  form  ar,(t+)  =  SiX(t~)  whore  each  is  con¬ 
stant  and  X  ~  [a?Ja:JxJ]r, 

•  a  discrete-time  part  described  by  a  finite  number  of  different  state  transition 
matrices  of  the  form  a?d(i+)  —  DiX(t~)  where  each  A  is  constant . 

The  usual  continuous  measurement  and  feed-forward  matrices  (C  and  D),  typical  of 
the  general  linear,  time-invariant  system,  are  embedded  in  the  Si  and  A  matrices. 
Any  number  of  arbitrary,  periodic  sample  schedules  may  simultaneously  control  the 
discrete  time  events  (Si  and  A).  The  main  restriction  in  both  the  analysis  and 
design  methods  is  that  the  closed  loop  state  transition  matrix  (STM)  must  have 
a  full  set  of  eigenvectors  (non-defective).  However,  the  design  method  extends  to 
defective  STM  with  repeated  eigenvalues  at  zero. 

1.5  Contributions 

The  primary  contributions  of  this  research  are: 

•  The  sufficient  stability  criterion  for  asynchronous  digital  systems. 


1.5.  Contributions 
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•  An  improved  constrained  optimization  synthesis  method  for  synchronous  mul¬ 
tirate  designs. 

•  Extension  of  the  synchronous  multirate  method  to  the  synchronous  case  with 
random  phasing  and  to  the  asynchronous  case. 


Chapter  2 

Problem  Description 


This  section  defines  synchronous  and  asynchronous  sampling  and  discusses  reasons 
for  employing  asynchronous  designs.  The  merits  of  fast  and  slow  sample  rates 
are  discussed.  Finally,  several  current  design  approaches  and  their  limitations  are 
reviewed. 


2.1  Motivation 

Multirato  digital  control  design  is  motivated,  primarily,  by  plants  with  a  wide  range 
of  natural  frequencies.  For  example,  if  the  plant  has  a  100  Hz  mode  and  a  1  Hz  mode, 
the  fast  modes  may  require  300  to  1,000  control  updates  per  second  wliile  3  to  10 
updates  per  second  ore  adequate  for  the  1  Hz  mode.  Using  the  same  high  rate  for 
both  modes  wastes  computer  capacity  and  measurement/control  signal  bandwidth. 
Hence,  multirate  control  is  a  natural  approach  for  many  real  applications. 

The  usual  motivation  for  asynchronous  control  is  a  distributed  control  system 
architecture  with  multiple  controllers.  This  situation  may  occur  when  several  cheap 
computers  are  used  instead  of  one  expensive  computer  or  when  the  controllers  are 
not  physically  colocated.  In  either  case,  synchronizing  all  the  sample  processes  to 
the  same  master  clock  may  increase  cost  and  complexity.  When  asynchronous  de¬ 
signs  give  adequate  performance,  the  additional  cost  and  complexity  is  unnecessary. 

System  integrity  requirements  may  also  motivate  asynchronous  design.  In  a 
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fault-tolerant  design,  the  plant  may  have  several  independent  controllers,  each  ca¬ 
pable  of  controlling  the  plant  with  the  others  failed.  In  this  case,  requiring  synchro¬ 
nized  controllers  may  introduce  a  single-point  failure  mode. 


2.2  Asynchronous  Definitions 

The  problem  is  to  devise  methods  to  design  and  analyze  systems  with  asynchronous 
digital  controllers.  Key  asynchronous  concepts  and  definitions  are  now  reviewed  to 
help  clarify  and  focus  the  problem. 


2.2.X  Simultaneous  Sample  Processes 

Asynchronous  systems  have  two  or  more  independent  digital  controllers  operating 
simultaneously  as  shown  in  Figure  2.1.  The  relative  timing  between  the  sample 
processes  will  be  called  phase  (precise  definition  later).  The  overall  sequence  of 
events,  or  sample  schedule,  is  found  by  superimposing  events  from  the  independent 
processes  as  shown  in  Figure  2.2. 


Figure  2.1:  Simultaneous  Independent  Controllers 


2.2.  Asynchronous  Definitions 
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Figure  2.2:  Superposition  of  Simultaneous  Independent  Sample  Processes 


2.2.2  Synchronous  and  Asynchronous  Sampling 


The  intuitive  idea  of  asynchronous  sampling  (independent  samplers  with  no  master 
clock)  is  essentially  correct.  In  practice,  independent  clocks  do  not  stay  synchronized 
exactly.  Therefore,  even  identical  samplers  will  drift  in  “phasing”  when  controlled 
by  independent  clocks.  A  rigorous  definition  for  asynchronous  and  asynchronous 
sampling  follows. 

Consider  a  system  with  n  periodic  sampling  processes  with  periods  Ta, . . .  T„. 
If  there  exists  a  set  of  positive  integers  {Jt»,  Jkj,  . ..,  &„}  such  that  Tife*  =  TjJfcj  = 
•  *  *  —  2U'n,  then  the  system  is  synchronous.  Alternatively,  the  ratio  of  every  two 
sample  periods  is  a  rational  number  for  synchronous  systems.  Synchronous  systems 
are  periodic  with  finite  period  (period  =  Tit.). 

Conversely,  asynchronous  systems  have  at  least  one  pair  of  sample  periods  whose 
ratio  is  irrational.  With  asynchronous  sampling,  the  sample  schedule  is  not  periodic. 
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2.2.3  Basic  Time  Period 

Observe  that  if  the  set  {fci,  &2,  . . .  ifcn}  satisfies  the  above  condition  for  synchronous 
sampling,  then  {jki,  jk2, . . . jkn }  ,  with  j  a  positive  integer,  also  satisfies  the  condi¬ 
tion.  A  unique  basic  time  period  (BTP)  for  synchronous  systems  is  defined  as 
where  { k\ ,  fc2,  ...  kn)  have  no  common  factors. 

A  non-unique  basic  time  period  (BTP)  can  be  defined  for  asynchronous  systems 
as  follows.  Suppose  the  designer  selects  a  set  of  positive  integers  {fc*,  k2,  ...&„} 
such  that:  T\kx  »  T2&2  »  •••  f»  Tn&n.  Then  is  a  BTP  and  the  i’th  sample 
sequence  is  designated  the  key  sequence  (since  the  BTP  is  keyed  to  that  sequence). 
Note  that  there  are  an  infinite  number  of  choices  for  the  k's.  The  Tjkj  products  can 
be  made  arbitrarily  close  by  choosing  Large  fc’s  (long  BTP’s).  This  is  analogous  to 
using  fractions  to  approximate  irrational  numbers. 


2.2.4  Phase 

For  a  given  BTP,  the  phase  of  a  sequence  is  the  elapsed  time  from  the  start  of  the 
BTP  to  the  initial  discrete  event  of  the  sequence.  By  convention,  every  sequence 
starts  with  a  discrete  event.  The  key  sequence  phase  is  defined  to  be  zero  so  all 
plmses  are  unique. 

Let  Ti  be  the  period  of  the  key  sequence  and  Tt  be  the  period  of  some  other 
sequence:  *V\  If  Tiki  £  TskX}  phase  for  sequence  ux"  will  be  different  in  successive 
BTP’s.  If  sequence  and  sequence  are  asynchronous,  then  is  irrational 
and  sequence  *x’  lias  a  different  phase  in  every  BTP.  Finally,  if  ^  is  irrational,  the 

M 

piiase  of  sequence  ux”  is  assumed  to  be  uniformly  distributed  on  (0  Tx)  when  all 
future  BTP’s  are  considered. 

Figure  2.3  illustrates  these  ideas  for  the  two-sequence  case  where  Tt  =  T2  ^  1, 
L't  ==  1,  and  =  3.  The  phase  of  the  asynchronous  sequence  is  r.  Note  that  each 
BTP  has  a  unique  r  and  each  r  uniquely  defines  the  subsequent  r. 


2.3.  Sample  Rate  Considerations 
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Figure  2.3;  Asynchronous  BTP  and  Phase 


2.2.5  BTP  Segments  and  Events 

Each  BTP  consists  of  periods  of  continuous  state  propagation  separated  by  discrete 
state  updates  (e.g.  sample-aud-hold  updates).  Each  period  of  continuous  shite 
propagation  with  constant  discrete  states  is  called  a  segment.  Each  discrete  state 
(1,  or  14)  update  is  called  an  event. 


2.3  Sample  Rate  Considerations 

Many  current  designs  use  high  sample  rates.  Such  sample  rates  are  much  itigher 
than  the  minimum  rates  needed  to  satisfy  performance  specification*.  In  some  cases 
(such  as  manual  control  systems)  other  considerations  mandate  high  rates.  In  other 
cases',  good  performance  can  be  achieved  with  lower  sample  rates. 

One  reason  for  using  liigh  sample  rates  is  that  a  fast  digital  controller  closely 
approximates  a  continuous  controller.  The  error  between  a  true  analog  controller 
and  the  digital  approximation  is,  effectively,  process  noise.  Consequently,  any  robust 
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analog  design  can  be  simulated  by  a  digital  controller  with  high  sample  rates.  Also, 
the  asynchronous  sampling  issue  can  be  safely  ignored  because  all  control  loops 
are  essentially  continuous  (with  process  noise)  and  asynchrony  is  a  discrete-time 
phenomenon. 

High  sample  rates  have  drawbacks.  The  most  obvious  is  the  cost  and  complexity 
of  fast  control  computers,  fast  analog/digital  converters,  and  wide-band  data  paths. 
Roundoff  error  accumulation  can  be  a  subtle  problem,  particularly  if  complex  pro¬ 
cessing  is  used.  Finally,  considerable  filtering  may  be  needed  to  estimate  rate  infor¬ 
mation  because  the  parameter  change  between  measurements  is  small  compared  to 
roundoff  error  (high  noise  to  signal  ratio). 

High  sample  rates  may  require  higher  analog/digital  conversion  precision  to 
control  roundoff  accumulation  and  to  reduce  process  noise  correlation  time.  This 
combination  of  high  data  rates  and  long  data  words  compounds  the  hardware  per¬ 
formance  requirements. 


2.4  Limitations  of  Existing  Design  Methods 

Highlights  of  several  representative  multirate  design  methods  will  be  reviewed  with 
emphasis  on  the  limitations,  design  difficulty,  and  implementation  difficulty. 

2.4.1  Ad  Hoc  Approaches 

First,  here  are  several  common  ad  hoc  approaches.  These  “methods”  often  work 
(i.e.  produce  acceptable  performance)  when  the  sample  rate  is  high,  but  they  lack 
a  rigorous  theoretical  foundation.  These  methods  tend  to  break  down  when  slow 
sampling  is  used  and  when  the  different  sample  rates  are  nearly  equal.  These  are 
not  true  design  methods.  They  are  actually  methods  of  approximating  the  multirate 
problem  as  a  series  of  single-rate  approximations  which  can  solved  by  existing  single 
rate  methods.  The  design  difficulty  and  controller  complexity  are  determined  by 
the  underlying  single-rate  method. 


2.4.  Limitations  of  Existing  Design  Methods 
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Discretized  Analog  Design 

This  approach  starts  with  a  design  for  a  satisfactory  analog  controller.  Then,  a 
“digital  equivalent”  design  is  obtainei  from  the  analog  controller  design  (typically 
by  one  of  the  methods  in  [FP80]).  This  approach  can  always  be  used  and  cross¬ 
coupling  may  be  exploited  to  advantage  (if  the  analog  design  method  has  this  prop¬ 
erty).  However,  the  resulting  controller  may  be  unsatisfactory.  In  fact,  it  is  easy  to 
construct  simple  examples  where  adequate  analog  controllers  have  unstable  digital 
equivalents. 

One  Loop  at  a  Time 

This  approach  requires  the  designer  to  associate  groups  of  outputs  with  groups  of 
inputs  according  to  the  plant  modes  they  affect.  To  illustrate,  the  fastest  modes 
are  identified  along  with  inputs  that  can  control  those  modes  and  outputs  where 
those  modes  are  observable.  Then,  a  single  rate  controller  is  designed  for  this 
input/output/mode  group  using  some  standard  single  rate  method.  The  controller 
for  the  fast  inner  loop  now  becomes  part  of  the  plant  and  the  process  continues 
until  all  loops  are  closed  and  all  modes  are  controlled. 

If  all  sample  rates  are  integer  multiples  of  the  next  slower  sample  rate  and  all 
samplers  are  synclironized,  this  is  the  exact  one  loop  at  a  time  method  discussed  in 
the  next  section.  Otherwise,  analog  approximations  of  each  succeeding  controller 
must  be  used  to  define  each  “new”  analog  plant  containing  embedded  digital  inner- 
loop  controller's. 

This  method  is  very  general  and  can  always  be  used.  However,  the  best  group¬ 
ing  of  inputs  and  outputs  may  be  unclear.  Furthermore,  coupling  between  mode 
controls  is  one-way  in  the  sense  that  slow  modes  are  designed  considering  the  fast 
modes  (which  are  now  part  of  the  plant)  but  not  vice-  versa.  Consequently,  the 
fast  modes  may  not  compensate  for  shortcomings  in  the  slow  modes.  Finally,  the 
assumption  that  the  fast  inner  loops  are  “almost  continuous"  is  valid  only  if  each 
inner  loop  sample  rate  is  much  faster  than  the  next  outer  loop.  In  short,  the  result¬ 
ing  design  may  work  well  or  it  may  be  unstable;  simulations  arc  needed  to  validate 
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the  results. 


Singular  Perturbation  Method 

The  singular  perturbation  concept  for  ignoring  minor  effects  has  been  rigorously 
studied  [Kok84],  The  method  discussed  here  employs  the  general  singular  pertur¬ 
bation  idea  without  rigorous  analysis. 

This  is  similar  to  the  “one  loop  at  a  time  method”  but  in  the  reverse  order.  The 
fast  modes  should  be  much  faster  then  the  slow  modes.  If  the  fast  modes  are  well 
controlled  (closed  loop)  then  the  fast  modes  can  be  assumed  in  constant  equilibrium 
with  the  slow  modes  when  the  slow  modes  are  analyzed.  Conversely,  the  slow  modes 
are  assumed  constant  when  the  fast  modes  are  being  analyzed.  Stated  another  way, 
the  fast  mode  transient  dies  so  quickly  that  the  slow  modes  do  not  respond  to  it; 
hence,  the  mode  groups  are  effectively  decoupled. 

This  method  designs  the  slow  controller  first  based  on  the  assumption  that  the 
fast  modes  are  in  constant  equilibrium.  Then  a  fast  controller  is  designed  based  on 
the  partially  closed-loop  system  including  the  slow  controller.  For  the  sampled  data 
case,  the  fast  controller  is  designed  assuming  the  slow  modes  (or  the  slow  controls 
at  least)  are  constant.  This  is  clearly  an  approximation  in  the  discrete-time  case. 

The  advantages  and  disadvantages  of  this  method  are  essentially  the  same  as 
for  the  one  loop  at  a  time  method  except  that  the  cross  coupling  is  reversed.  This 
reversal  is  usually  good  since  fast  modes  are  better  able  to  compensate  errors  in 
slow  modes  than  the  other  way  around.  The  approach  is  limited  to  cases  where  the 
plant  modes  are  well  separated  in  frequency. 

2.4.2  Exact  Methods 

These  methods  are  rigorous  for  true  lumped,  linear  time-invariant  plants.  Hence, 
controllers  designed  with  these  methods  should  perform  as  predicted  (except  for 
plant  model  error).  However,  all  these  methods  are  limited  to  the  synchronous 
sampling  cose. 
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One  Loop  at  a  Time 

This  method,  discussed  earlier,  becomes  exact  when  each  sample  rate  is  an  integer 
multiple  of  the  next  slower  rate  and  the  samplers  are  synchronized.  In  this  special 
case,  the  continuous  plant  can  be  transformed  into  a  true  discrete  equivalent  model 
and  the  design  can  be  done  entirely  in  the  Z-domain.  All  the  earlier  comments  con¬ 
cerning  this  method  apply  except  the  model  becomes  exact  (analog  approximation 
is  eliminated)  and  the  sample  rates  must  be  synchronized  integer  multiples.  The 
design  difficulty  and  controller  complexity  are  determined  by  the  method  used  to 
design  each  loop. 

Frequency  Domain  Methods 

The  original  multirate  methods  were  the  Switch  Decomposition  technique  of  Kranc 
[Kra57]  and  Frequency  Decomposition  technique  of  Sklonsky  [SR55].  Jury  [Jur68] 
later  showed  these  techniques  to  be  equivalent. 

Switch  Decomposition  For  synchronous  sampling,  the  sample  process  repeats 
each  BTP.  The  switch  decomposition  formulation  uses  samplers  which  all  operate 
simultaneously  at  the  BTP  rate  with  advances  (exp{sT,))  and  delays  (exp(-s2)))  to 
shift  the  sample  time  and  the  control  output  times  to  the  appropriate  points  within 
the  BTP. 

This  is  an  exact  analysis  technique  for  synchronous  multirate  systems.  It  is 
primarily  an  analysis  method.  Therefore,  it  gives  little  guidance  for  choosing  the 
controller  structure  or  gains  in  the  multi-input/multi-output  case. 

Frequency  Decomposition  The  frequency  decomposition  method  can  be  ap¬ 
plied  when  all  sample  periods  are  integer  multiples  of  some  short  time  period.  Dis¬ 
crete  equivalents  (T(z„))  of  the  continuous  transfer  functions  are  developed  for 
sampling  at  the  short  time  period.  Then  T(z*)  represents  the  discrete  transfer 
function  for  a  slower  sampler  with  period  Mk”  times  the  short  time  period. 

This  too  is  an  exact  analysis  teclmique  for  synchronous  multirate  systems.  Like 
switch  decomposition,  it  gives  little  guidance  for  choosing  the  controller  structure 
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or  gains  in  the  multi-input/multi-output  case. 

Time  Domain  Methods 

Optimal  Synthesis  Several  investigators  including  Amit  [Arai80],  Glasson  [GB79], 
and  Lennartson  [Len86]  have  devised  different  ways  to  solve  this  problem.  This  is 
an  optimal  regulator  problem  where  state  feedback  gains  are  found  to  minimize  a 
scalar  cost  function.  The  cost  function  is  a  standard  Linear  Quadratic  Regulator 
(LQR)  cost  integral.  The  solution  is  found  from  solving  the  resulting  time- varying 
periodic  Riccati  Equation.  The  resulting  gains  are  periodic  but  different  for  each 
segment  of  the  BTP. 

Controllers  designed  by  this  approach  should  exhibit  the  harmonious  control 
blending  and  robustness  characteristics  of  other  optimal  regulators.  Furthermore, 
the  design  process  is  automatic  once  the  weights  and  process  noise  are  specified. 
Recent  work  [Len86]  claims  efficient  methods  to  solve  the  time- varying  Riccati  Equa¬ 
tion. 

The  approach  is  limited  to  synchronous  systems.  Also,  measurements  of  all 
states  must  be  available.  Finally,  the  resulting  controller  is  relatively  complex  since 
it  must  schedule  different  gains  for  each  segment  in  the  Basic  Time  Period. 

Constrained  Optimal  Synthesis  Berg  [Ber86]  developed  this  approach  to  gen¬ 
eralize  the  optimal  synthesis  design  method.  The  same  cost  function  is  used;  how¬ 
ever,  the  designer  specifies  the  form  of  the  controller.  The  optimal  gains  for  the 
specified  controller  structure  are  found  by  numerical  optimization. 

This  method  has  many  of  the  advantages  of  the  Optimal  Synthesis  method 
with  the  added  advantage  of  handling  a  variety  of  control  structures.  Hence,  simple 
controllers  with  fixed  gains  and  partial  state  feedback  and  controllers  with  dynamics 
can  also  be  considered. 

The  method  is  limited  to  synchronous  sampling.  The  added  flexibility  requires 
the  designer  to  guess  the  best  controller  structure.  Finally,  the  gradient  search 
for  optimal  control  coefficients  (particularly  in  the  original  implementation)  can  be 
computationally  intensive  and  requires  frequent  designer  intervention  to  fine-tune 


2.4.  Limitations  of  Existing  Design  Methods 
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the  convergence  process. 

2.4.3  Common  Limitations 

All  of  the  exact  methods  require  synchronous  sampling.  None  of  the  methods  have 
objective  criteria  for  optimal  sample  rate  selection.  Only  the  Optimal  Synthesis 
methods  addressed  finite  word-length  (quantization  and  roundoff  error)  and  plant 
uncertainties  (design  robustness)  by  including  process  noise.  None  of  the  methods 
directly  addressed  system  integrity  with  respect  to  failures. 


Chapter  3 

Definitions,  Conventions,  and 
Notation 


This  section  addresses  a  variety  of  background  items,  definitions,  and  notation  that 
provide  a  foundation  for  subsequent  chapters.  The  system  description  nomenclature 
parallels  the  corresponding  variables  in  the  PC-MATLAB  code  (Appendix  E). 

3.1  Synchronous  Sampling 

Consider  a  system  with  n  periodic  sampling  processes  with  periods  T\,  Tj,  . .  .T„. 
If  there  exist  a  set  of  positive  integers  {li,  fcj, . . .,  kn]  such  that 

(3.1) 

then  the  system  is  synclironous  and  periodic  with  period  Tiki. 


3.2  Basic  Time  Period 

3.2.1  Synchronous  Basic  Time  Period 

A  unique  basic  time  period  (BTP)  for  synchronous  systems  is  defined  as  where 
{Ti,  Ta, . . .  rn}  and  {li,  la*  .••!»}  satisfy  Equation  3.1  and  {fci,  •  ••!*»}  have  no 
common  factors. 
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For  synchronous  sampling,  the  BTP  is  unique.  A  synchronous  BTP  is  the  short¬ 
est  period  such  that  the  discrete  event  sequence  is  the  same  for  all  BTP’s.  The  state 
transition  matrix  is  the  same  for  all  synchronous  BTP’s. 

3.2.2  Asynchronous  Basic  Time  Period 

A  non-unique  basic  time  period  (BTP)  for  asynchronous  systems  is  defined  as  Tjfc,- 
where  the  designer  selected  a  set  of  positive  integers  { k\ ,  •  •  •  K}  such  that: 

Tik\  «  T2&2  »  •  •  •  «  Tnkn. 

Also,  the  i’th  sample  sequence  is  defined  as  the  key  sequence  (since  the  BTP  is 
keyed  to  that  sequence). 

For  asynchronous  sampling,  the  designer  specifies  the  BTP.  The  asynchronous 
BTP  is  not  unique.  The  sequence  and  timing  of  the  discrete  events  is  never  exactly 
the  same  for  any  two  BTP’s;  however,  the  discrete  event  sequence  and  timing  is 
nearly  the  same  for  each  pair  of  sequential  BTP’s.  The  key  sequence  is  always 
synchronized  with  the  BTP. 

3.2.3  Sequence  Phasing 

The  phase  (r)  of  a  sequence  is  defined  as  the  elapsed  time  from  the  start  of  a  BTP 
to  the  initial  discrete  event  of  the  sequence.  Defining  key  sequence  phase  to  be  zero 
makes  the  other  phases  unique.  Figure  3.1  illustrates  this  concept. 

Let  Ti  be  the  period  of  the  key  sample  sequence  and  Tx  be  the  period  of  some 
other  sequence.  Observe  that  phase  for  sequence  ux”  will  be  different  in  subsequent 
BTP’s  unless  Tjfc,  =  Txkx.  Furthermore,  if  the  ratio  Tx  to  T,  is  irrational,  then 
sequence  ux”  will  have  a  different  phase  in  every  BTP.  Finally,  this  phase  is  assumed 
to  be  uniformly  distributed  on  [0  Ts)  when  sampling  is  asynchronous. 

For  a  given  BTP,  the  sequence  and  timing  of  the  discrete  events  is  uniquely 
described  by  a  vector  of  phase  times  (one  component  for  each  sample  sequence). 
By  convention,  the  phase  time  for  the  key  sequence  is  always  zero.  Hence,  if  there 
are  n,  sample  sequences,  there  are  n,  phase  times  but  one  of  these  is  zero. 


3.3.  Kalman-Bertram  Representation 
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Figure  3.1:  Phase  Concept 


3.3  Kalman-Bertram  Representation 

In  [KB59],  Kalman  and  Bertram  present  a  systematic  way  to  construct  the  state 
transition  matrix  (STM)  for  an  arbitrary  hybrid  analog/digital  system  over  an  ar¬ 
bitrary  time  period.  Part  of  their  approach,  which  is  used  in  this  paper,  will  be 
summarized  here. 


3.3.1  The  State  Vector 

The  state  vector  has  three  parts:  continuous  states,  sample  states,  and  discrete 
states.  If  the  system  were  represented  as  a  block  diagram  composed  of  integrators, 
sample-and-hold  elements,  and  discrete  delay  elements,  the  integrator  outputs  are 
continuous  states,  the  sample-and-hold  outputs  are  sample  states,  and  the  delay  el¬ 
ement  outputs  are  discrete  states.  Figure  3.2  represents  the  general  hybrid  system 
where  all  paths  represent  vector  quantities.  Integrator  iuputs  can  only  be  con¬ 
nected  (through  gains)  to  integrator  outputs  and  sample-and-hold  outputs  because 
delay-element  outputs  are  undefined  between  discrete  events.  The  equations  for  the 
samplers  include  the  usual  continuous  output  and  feedforward  matrices  (WC"  and 
UD”).  Also,  the  sampler  equations  must  avoid  any  algebraic  loops  or  the  problem 
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will  be  ill  posed.  These  three  types  of  states  represent  all  the  memory  in  the  system. 
Hence,  the  system  state  is: 


X  = 


Xc 

Xd 


where:  xc  is  a  column  vector  of  continuous  states,  x,  is  a  column  vector  of  sample 
states,  and  Xd  is  a  column  vector  of  discrete  states. 


Figure  3.2:  Block  Diagram  of  Hybrid  System 


3.3.2  State  IVansition  Matrices 

There  are  two  types  of  state  transitions:  continuous  transitions  and  discrete  tran¬ 
sitions.  Continuous  transitions  occur  during  segments  and  discrete  events  occur 
between  segments. 


3.3.  Kalman-Bertram  Representation 
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Continuous  State  Transitions 

The  continuous  state  transition  can  be  computed  for  any  time  interval  (At)  contain¬ 
ing  no  sample  or  discrete  transitions.  Assume  the  continuous  state  space  description: 
xc  =  Axc  +  Bu  is  known  and  note  that  u(t)  =  x,  which  is  constant  during  At.  Use 
the  usual  zero-order-hold  continuous-to-discrete  conversion  (see  [FP80]  or  [Kai80]) 
to  obtain: 

x  c(t0  +  At)  =  <j>(At)xc(t0)  +  T(  At)u(to) 
where  <f>( At)  =  exp(AAt)  and  T(At)  =  exp (As)B  ds.  Or: 

xc(iQ  +  At)  =  <j>(At)xc(tQ)  +  r(At)*,(t0). 


Combining  this  witha:f(t0  + At)  =  I,xt(ta)  and  xj(to+At)  =  IdXd(to),  where  I,  and 
Id  are  identity  matrices  of  the  correct  size,  yields  the  full  state  transition  matrix: 


X(to  4-  At)  = 


<f>(At)  T(At)  0  ' 

*c(<o) 

o 

»-r 

o 

x4(<0) 

0  0  Jd 

.  *d(to)  . 

=  ®(At)X(t0). 


(3.2) 


Given  a  fast  and  reliable  matrix  exponentiation  routine  [MVL78],  a  simple  way 
to  find  <f>(At)  and  F(At)  is  given  by  (VL78): 


<f>(At)  T(At) 
0  I. 


Another  form,  useful  in  derivations  is: 


/ 

A  B  o‘ 

$(At)  5S  exp 

0  0  0 

At 

o 

o 

o 

_ 2 

(3.3) 


(3.4) 


Sample  State  and  Discrete  State  Transitions 

Transition  matrices  for  sample  states  can  be  found  by  inspection.  For  example, 
suppose  the  sample  event  consists  of  sample  and  hold  state  uk”  sampling  state  Mm” 
through  a  gain  Km  and  state  “a”  through  a  gain  Kn  (i.e.  x k(t+)  =  KmXn(t~)  4* 
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Knxn(t~)).  The  corresponding  state  transition  matrix  is  just  an  identity  matrix 
with  the  k’th  row  replaced  by  the  row  vector: 

[  0  •••  0  Km  0  •••  0  Kn  0  •••  0  ] 

where  Km  is  in  the  m’th  column  and  Kn  is  in  the  n’th  column. 

Similarly,  the  discrete  state  transition  matrices  are  obtained  from  the  difference 
equations  by  inserting  the  difference  equation  coefficients  into  the  corresponding 
rows  of  the  transition  matrix.  The  remaining  rows  of  the  matrix  are  the  same  as 
an  identity  matrix. 

The  transition  matrices  for  sample  and  discrete  state  transitions  are  essentially 
similar  and  a  single  discrete-time  transition  often  updates  both  sample  states  and 
discrete  states.  The  main  reason  for  differentiating  between  sample  and  discrete 
states  is  that  sample  states  control  the  continuous  states.  Therefore,  the  sample 
states  should  be  grouped  together  in  the  state  vector  so  the  columns  of  F  stay 
together. 


3.3.3  BTP  State  Transition  Matrix 

Given  the  discrete  transition  matrices  (Du  •  •  • »  Dn) ,  A,  and  B,  a  state  transition 
matrix  for  a  BTP  can  be  constructed  for  any  specified  sequence  of  events.  To 
illustrate,  suppose  the  BTP  begins  with  a  discrete  event  of  type  1,  followed  by 
elapsed  time  <t,  followed  by  a  discrete  event  of  type  2,  and  finally  an  elapsed  time 
completing  the  BTP  (see  Figure  3.3).  The  corresponding  state  transition  matrix 
for  this  sequence  is  simply: 

*~$(t2)D2$(U)Dx. 

3.4  Asynchronous  System  Description 

We  need  a  precise  and  compact  notation  to  describe  a  hybrid  (analog  and  discrete) 
system  with  arbitrary  periodic  sampling.  The  notation  shown  here  parallels  the  PC- 
MATLAB  code  in  Appendix  G.  The  continuous-time  (analog)  part  of  the  system  is 
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D1 


time 


Figure  3.3:  Event  Timeline  Illustration 


completely  specified  by  the  A  and  B  matrices  of  the  matrix  differential  equation: 
xc  =  Axc+Bxt.  The  columns  of  B  are  arranged  so  they  are  in  one-to-one  correspon¬ 
dence  with  the  sample-and  hold  states.  For  example,  a  duplicate  column  is  added 
for  a  particular  input  if  two  separate  sample  states  drive  the  input.  Conversely, 
columns  for  two  different  inputs  might  be  summed  into  a  single  column  if  one  hold 
state  drives  two  inputs.  For  computational  simplicity,  A  and  B  can  be  3tored  as  a 
single  square  array  (zero-filled  at  the  bottom): 


AB~ 


A  B 
0  0 


Thus  the  full  analog  transition  matrix  can  bo  evaluated  as; 

cxp{AJ?At)  0 

0  h 

Each  sample  schedule  is  finite  and  periodic  so  there  are  only  a  finite  number 
of  different  discrete  time  transitions.  In  practice,  discrete  transitions  often  update 
both  sample  and  discrete  states,  so  no  distinction  is  made  between  discrete-time 
transitions  that  update  sample  states  and  discrete-time  transitions  that  update 
discrete  states.  The  discrete  transitions  are  numbered  arbitrarily  and  the  full  state 
transition  matrices  can  be  stored  as  DS,  a  row  of  square  block  arrays: 


<&(A  <)  = 


[  Dx  D2  ...  D *  ]. 


The  sample  sequences  are  defined  by  a  rectangular  “sequence  pointer”  array 
which  has  a  row  for  each  sample  sequence  and  enough  columns  to  describe  the 
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time 


Figure  3.4:  Timeline  Illustration 


longest  sequence.  Negative  integers  indicate  discrete  transitions  defined  by  the  cor¬ 
responding  block  of  the  DS  array.  Non-negative  real  numbers  indicate  the  duration 
of  continuous-time  transitions.  When  some  sequences  are  longer  than  others,  rows  of 
the  short  sequences  are  filled  with  zeros  (indicating  a  continuous  transition  for  zero 
elapsed  time:  i.e.  no  transition).  By  convention,  the  first  event  in  every  sequence 
is  a  discrete  event.  To  illustrate,  consider  the  sequences  sketched  in  Figure  3.4 
described  by  the  sequence  pointer: 


seqptr  = 


-1  0.1  -2  0.4 
-3  0.3  0  0 


Tins  array  indicates  two  simultaneous  sequences.  The  first  sequence  has  period  0.5 
and  consists  of  discrete  event  1  followed  by  discrete  event  2  after  a  delay  of  0.1. 
The  second  sequence  is  just  discrete  event  3  repeated  with  period  0.3.  Based  on  the 
preceding  BTP  discussion,  this  is  a  synchronous  system  with  BTP&1.5. 


3.5  Cost  Function 

A  generalized  Linear  Quadratic  Regulator  (LQR)  cost  function  b  used  in  the  design 
method.  One  would  expect  that  the  resulting  designs  share  the  desirable  robust 


3.S.  Cost  Function 
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properties  of  the  LQIl. 

The  cost  function  in  [Ber86]  was: 


J(N)  =  E< 


where  PT  is  the  BTP,  E{*}  is  the  expected  value  operator,  and  Q  and  R  are  designer- 
specified  weighting  matrices.  The  initial  state  covariance  was  zero  (E{a:(0)x:r(0)  = 
0})  and  the  analog  process  noise  had  covariance  W(t).  If  Q,  R,  and  W  are  either 
constant  or  periodic  with  period=BTP  (as  in  [Ber86]),  then  as  N  — ►  oo  this  cost 
becomes  the  steady-state  mean  square  state  error  and  control  effort  weighted  by  Q 
and  R.  In  the  limit,  this  is  exactly  equivalent  to 


J  =  E< 


1 


2PT  Jo 


tPT 

JO 


x(t) 

u(t) 


Q(t)  0 
0  R(t) 


x(t) 

u(t) 


dt 


if  the  process  noise  begins  at  t  —  — oo.  In  this  case,  E{x(0)xr(0)}  is  a  steady  state 
value  at  BTP  start,  not  zero. 

For  the  formulation  in  this  paper,  controls  and  states  are  combined  in  a  single 
state  vector.  The  above  cost  function  is  generalized  to: 

1  xJt)  f 

rBTP 


J  =  E 


I-/ 

'•TP  Jo 


xc(t) 
*«(<) 
L  *<!'(*) 


«hl 

tv2i 

0 


w12  0 

U>22 

W32  tO  33 


1 

=  e|^  /"VwiVolW*)]*}, 


T 

«c(<) 

1 

Xt(t) 

dt 

.  xd(t)  . 

(3.5) 


where  Wq  is  a  positive  semi-definite  cost  weighting  matrix  specified  by  the  designer. 
If  state  errors  are  equally  serious  throughout  the  BTP,  a  constant  Wo  is  not  a 
significant  limitation.  Choosing  non-zero  values  for  1031  and  w\o  makes  the  cost 
computation  significantly  more  difficult.  There  is  no  apparent  reason  to  specify  non¬ 
zero  values  for  to3i  and  u>13,  so  they  are  zero  by  convention  and  the  PC-MATLAB 
computer  codes  in  Appendix  E  do  not  include  contributions  from  W31  and  1^13. 
Conversely,  non-zero  values  for  W33,  u>12,  and  w2z  can  be  used  to  avoid  saturation 
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and  limits.  Observe  that  ti?n  =  P  and  W22  —  Q  so  this  formulation  is  exactly  the 
same  as  [Ber86]  when  the  other  Wi,  terms  are  zero.  Finally,  W22  should  be  positive 
definite  to  insure  that  infinite  control  commands  are  not  allowed. 


3.6  Process  Noise 

The  process  noise  used  here  is  also  an  extension  of  the  continuous  process  noise 
used  in  [Ber86].  The  process  noise  covariance  is  described  by: 


X°  = 


,0 

0 

0 


0  0 
^22  3-23 


X 
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where  x^  =  £{u>(t)u)T(t)}  is  the  continuous  process  noise  covariance.  This  is  the 
same  as  the  process  noise  in  [Ber86]  when  xv(t)  is  stationary.  The  other  terms: 
x°2,  X23,  X32,  and  X33  are  discrete  process  noises  covariances  which  are  added  to  the 
state  error  covariance  whenever  the  corresponding  states  are  updated.  To  illustrate, 
suppose  that  state  i,  a  sample  state,  and  state  j ,  a  discrete  state,  are  updated 
simultaneously  by  the  same  discrete  state  transition  matrix;  then,  X°(i,i),  X°(j, ;), 
X°(t,  j),  and  X°(j,  i)  are  added  to  the  coxrespondiag  elements  of  the  state  error 
covariance  matrix  when  the  transition  occurs.  These  additional  terms  can  be  used 
to  specify  digital  measurement  noise  since  all  sampled  measurements  immediately 
become  discrete  or  sample  states. 


3.7  Cost  Function  Scope 

Before  continuing,  note  that  this  extended  cost  function  is  quite  general.  The 
traditional  Linear  Quadratic  Gaussian  (LQG)  cost  function,  with  process  noise  and 
measurement  noise,  is  fully  accommodated  within  the  framework  of  the  extended 
cost  function.  Equivalent  process  noise  (in  the  x,  and  x<j)  can  be  found  from  discrete 
measurement  noise.  Hence,  this  formulation  will  accomplish  LQG  design  if  the 
controller  structure  is  on  observer  with  state  feedback. 
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In  addition,  the  off-diagonal  WQ  blocks  allow  penalties  that  can  be  used  to  avoid 
state  and  control  limits.  For  example,  suppose  state  j  is  limited  and  ij  =  a :*  where 
Xk  is  a  hold  state  (i.e.  a  control),  then  W0(j,  k)  >  0  penalizes  control  that  pushes 
Xj  toward  the  limit,  particularly  when  Xj  is  large.  The  W23  block  can  be  used  in  a 
similar  way  to  avoid  control  limits. 
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Chapter  4 


Asynchronous  Stability  Condition 

This  chapter  develops  the  sufficient  stability  condition  for  an  asynchronous  sampled 
data  system.  Specifically,  if  the  sum  of  two  integrals  is  negative,  the  system  is  stable 
on  the  average.  Furthermore,  this  sum  defines  an  upper  bound  on  the  exponential 
decay  constant  for  the  average  state  error  decay  rate.  An  analogous  figure  of  merit 
for  linear,  time  invariant  continuous  systems  is  a  rightmost  bound  on  the  pole  lo¬ 
cations  in  the  s-plane.  Finally,  plots  of  the  two  integrands  show  how  stability  is 
influenced  by  asynchrony  and  phasing.  Hence,  the  approach  is  also  useful  for  syn¬ 
chronous  systems  with  unknown  phase.  Although  the  method  is  applicable  to  any 
number  of  asynchronous  sample  schedules,  a  simple  two-schedule  (one  asynchronous 
schedule)  version  is  derived  and  used  for  the  examples  in  the  next  chapter.  The 
main  limitation  is  that  the  closed-loop  BTP  state  transition  matrix  (STM)  must  be 
diagonalizable. 

4.1  Stability  Definition 

Consider  a  linear,  time-varying  system  with  a  state  vector  #(t)  and  a  state  transition 
matrix  ^(</,fo)  such  that  x(<;)=s  <&(*/,  <0M<o)- 

A  necessary  and  sufficient  condition  for  global  asymptotic  stability  is: 

jlim)o(4,(</t<o))  -*  0,  for  all  <o  (4.1) 
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where  a(-)  denotes  the  maximum  singular  value  of  a  matrix.  This  stability  definition 
will  be  used  throughout  this  paper.  Note  that  this  says  that  each  element  in  \&(oo,  to) 
must  be  zero. 


4.2  Factors  of  ^ 

For  reasons  that  will  be  apparent  later,  $  will  first  be  factored  in  a  certain  way. 

Divide  the  interval  [t/, to]  into  finite  segments  [tn,tn_i],..., [ij, ti], [ti,t0]  such 
that  n— >  oo  as  tf  — ►  oo.  Then,  ^(t/,t0)  in  Equation  4.1  can  be  factored  as 

*(t/,t0)  =  *n*  n-1— *3*1 

where  ^k  is  defined  as  \&(fj.,  tj,_ i).  Later,  these  intervals  will  be  set  to  the  “basic 
time  period”  (BTP). 

When  the  individual  'ft’s  are  diagonalizable  (not  defective)  each  can  be 
factored  ('Ih  =  SkA-kS^1)  where  A  is  a  diagonal  matrix  of  eigenvalues  and  S  is  a 
matrix  of  eigenvectors.  Then  ^(t/,t0)  can  be  expanded: 

*(</,  *o)  =  SnAnS;xSn^An.xS-lv  •  -SiAtSS'SxAxS?1. 

Finally,  factor  each 


where  X*  is  the  spectral  radius  of  A*  or  'P*.  Now: 

. .  .'i/ k^f k-\' •  ’  —  •  •  .SkAkS^  xSk-\ •  • 

~  •  *  '/^s^Sk~  ^  '  * 

where:  Ah  =  \]j^Sk  ‘  Sk~ i \jj^'  (4-2) 

So,  $(t/,to)  can  be  rewritten  in  factored  form  as: 

^  ^-XwAnAn-.iAw>i-  •  •AaAaXi^Xsf  *. 


*(</,<o)  =  Sn 


(4.3) 
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4.3  General  Sufficient  Condition 

Recalling  that  <?(•)  is  a  scalar  consider  an  equivalent  form  for  Equation  4.1: 
lim  cr{^(tf,t0))  — ►  0.  4=>  lim  [a(^n^„_r  •  <  1 

ty— .00  n-*oo 

Furthermore 

•  -X^AjJa ivUEsA  . 

Therefore  a  sufficient  stability  condition  is: 

Hm  5r^5n^5^/\„a(An)An-ia(A„_i)---A20r(A2)Ai5r^^£-i'i^  <  X.  (4.4) 

Suppose  we  define  bounds  and  cr,  and  the  A’s  and  A’s  are  divided  into  classes 
such  that  5(A)  <  <7,  for  all  the  A’s  in  class  “i”  and  X(^)  <  \j  for  all  X('P)’s  in  class 
“j”.  Also,  for  any  sequence  length  n  let  n,  be  the  number  of  A’s  in  class  “i”  and  let 
rij  be  the  number  of  A’s  in  class  Mj”.  Then 

A,,<?(A«)Xn..i<F(A*_i)*  •  = 

K  s^P4^H^s4k- 

W5>]  ’  «] " 

In  taking  the  limit  as  n  — ►  oo,  the  first  and  last  terms  (assumed  finite)  go  to 
unity  so  a  sufficient  stability  condition  becomes: 

.saiMnv*  -n«-nv''<i  m 

•  i  ‘  J 

where  p*.  and  p\j  are  the  p^bability  of  occurrence  of  state  transition  matrices  with 
A  in  class  i  and  X  in  clasi  j  respectively. 
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4.4  Asynchronous  Multirate  Stability 

Now,  apply  Equation  4.5  to  the  asynchronous  multirate  problem.  Let  each  [4,4_i] 
interval  be  a  basic  time  period  (BTP)  and  use  rectangles  in  phase  space  to  partition 
the  A’s  and  A’s  into  classes. 

Assume  that  the  phase  for  all  BTP’s  from  t  =  0  to  t  =  oo  is  uniformly  dis¬ 
tributed.  Then,  the  probability  of  occurrence  of  an  STM  in  a  given  class  is  equal 
to  the  size  of  the  phase  space  rectangle  divided  by  the  size  of  the  total  phase  space. 

Let  r  be  the  phase  vector  that  uniquely  defines  the  BTP  state  transition  matrix. 
Then,  for  the  k’th  component,  r*  €  [0,  Tk),  where  Tk  is  the  period  of  the  k’th 
sequence  (a  non-synchronous  sample  sequence).  Assume  the  rk' s  are  independent. 
Then,  the  probability  of  occurrence  of  a  sequence  with  rk  €  [<i,t2]  is  just 
assuming  0  <  tu  t2  <  Ti, 

If  we  take  the  natural  logarithm  of  Equation  4.5  we  get 

E  P<r*  logfo)  +  E  PV  loS(  Aj)  <  0*  (4.6) 

*  j 

another  form  of  the  sufficient  stability  condition. 

Suppose  we  divide  the  A’s  and  cF( 'flu's  into  classes  based  on  rectangles  (in  r 
space)  of  size  dr .  Say  the  t’th  class  is  defined  as  all  state  transition  matrices  with 
r\  e  (r,i ,  Til  +  dr),  ra  e  [r,a,  rj2  +  dr),  . . .  rn  e  [rin, rin  +  dr). 

Now,  Equation  4.6  can  be  expressed  as  sums  over  the  coordinate  indices  (»•  ♦  -j): 

drn  /jU.  \  drn  ( n>  n"  \ 

( £  •  ■  E 'ogto'"*)  +  D  •  ■  £ log(>i-i)  <0  (4.7) 

Ulal1'  \ial  jal  f  Uja)  y8i  J 

where: 

n  =  number  of  asynchronous  samplers, 

"• 

A;...;  =  sup(X(#(r))),  n  6  [(i  -  l)dr, idr),  r*  e  [(j  -  l)dr, jdr],  and 
ai  -i  -  aup(o(A(r))),  t,  6  [(i  -  l)dr,»dr],  •  •  •  r*  e  [(;  -  l)dr,jdrj. 


iAt  laudi  mi  tiw  tAi  rfti  tar  uAr  v-mt  ia uk 
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In  the  limit  as  dr  — ►  0,  the  sums  in  Equation  4.6  become  integrals: 

a0  =  -v— ■  /  1  •  •  •  /  "  (log(5r(A(r)))  +  log(X($(r))))  drv  •  • drn  <  0.  (4.8) 

I1{=X  Jn=0  Jrn- 0 

Also,  define  a*  =  -^p.  The  significance  of  a*  will  be  discussed  later. 

4.4.1  An  Important  Special  Case 

Finally,  consider  the  special  case  with  only  one  asynchronous  sampler.  Then,  r 
becomes  a  scalar  and  Equation  4.8  becomes: 

=  b  j  log(a(A(r))dr  +  ~  l  log(A(^(r))dr  <  0.  (4.9) 

1  J  T=0  1  J  T=0 

This  form  will  be  used  for  the  sample  cases  later  in  thi3  paper. 

4.5  Eigenvector  Scaling 

The  eigenvector  matrix  ( S )  needed  in  the  WA”  calculation  is  not  unique.  In  fact, 
the  choice  of  eigenvectors  changes  <r(r).  Ideally,  the  length  of  the  eigenvectors  in 
S  would  be  selected  to  minimize  a(r)  and  reduce  the  conservative  nature  of  the 
results.  The  best  5  (which  minimizes  «t(t))  is  not  obvious.  Numerical  stability  is 
another  consideration.  We  can  improve  the  numerical  properties  by  choosing  S  in 
balanced  modal  form  such  that  the  norms  of  the  columns  of  5  are  the  same  os  the 
norms  of  the  corresponding  rows  of  S~l.  In  some  of  the  example  cases,  the  balanced 
modal  form  improved  the  condition  number  of  5  (and  S“l)  significantly  compared 
to  choosing  eigenvectors  of  unit  length.  This  balanced  modal  decomposition  was 
implemented  in  the  computer  codes  in  Appendix  E.  In  most  cases,  the  result  ( a *) 
was  less  conservative  than  results  with  unit  eigenvectors. 

4.6  Analysis  of  Result 

Before  leaving  this  topic,  consider  the  significance  of  the  Equation  4.8.  Comparing 
tills  with  Equations  4.4  and  4.5  one  can  conclude  that,  in  some  average  fashion, 
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log(y(^(t0  +  BTP ,  t0)))  <  <7°.  Hence,  if  Xq  is  some  initial  state  and  Xx  is  the  state 
one  BTP  later,  then  on  the  average,  || J|  <  |jX0||  exp(<r°).  Hence,  cr°  is  like  a 
maximum  (conservative  bound)  decay  constant  for  one  BTP. 

The  term  “average”  was  used  loosely  in  this  discussion  since  it  actually  indicates 
a  multiplicative  average.  To  be  more  precise,  if  the  initial  state  error  is  X(0), 
then  the  residual  error  ||X(t)||  will  be  less  than  ||AC(0)||  exp(cr*t)  for  most  values  of 
t  E  [0,  oo).  So,  <r*  can  be  thought  of  as  an  average  worst  case  (conservative)  decay 
constant  per  unit  time. 

Now  consider  the  integrands  of  Equations  4.8  and  4.9.  The  BTP  STM  is  an 
analytic  function  of  phase  except  at  a  finite  number  of  points  (see  Appendix  C). 
Hence,  the  A/s  and  A’s  are  continuous  functions  of  r  except  at  a  few  known  values. 
Therefore,  the  integrals  can  be  computed  numerically  without  difficulty. 

Plots  of  the  integrands  of  Equation  4.9  versus  r  give  substantial  insight  into 
the  system  behavior.  If  a  system  were  actually  synchronous  with  random  phase, 
log  A(^(r))  must  actually  be  negative  for  all  r  for  guaranteed  stability.  Thus,  a 
plot  of  log X(®(r))  versus  r  shows  how  sequence  phasing  influences  the  stability  of 
a  synchronous  system.  Similarly,  a  plot  of  log<r(A(r))  versus  r  shows  the  possible 
destabilizing  effect  of  asynchronous  sampling.  Together,  these  plots  show  the  rel¬ 
ative  stability  contributions  of  transitions  over  the  BTP  (if  repeated  indefinitely) 
and  the  mismatch  in  going  from  one  BTP  to  the  next.  If  the  mismatch  is  too 
destabilizing,  longer  BTP’s  (closer  to  synchronous)  can  be  used  to  get  a  “sharper” 
sufficient  stability  criterion. 

To  illustrate,  consider  Figures  4.1  and  4.2.  Figure  4.1  represents  a  synchronous 
system.  For  synchronous  systems  at  the  synchronous  BTP,  logo(A(r))  —  0  for 
all  phase  values.  The  system  is  stable  for  some  values  of  phasing  (where  log(^) 
is  negative)  but  not  for  others.  If  Figure  4.1  represented  an  asynchronous  system, 
the  system  would  be  stable  overall  (area  below  curve  is  greater  than  area  above) 
but  the  errors  would  grow  during  some  BTP’s.  Such  behavior  may  be  acceptable 
if  these  “unstable”  BTP’s  are  mixed  with  stable  BTP’s.  Conversely,  if  there  are 
many  “unstable”  BTP's  in  a  row,  the  behavior  is  probably  unacceptable.  Figure  4.2 
represents  a  stable  asynchronous  system.  The  stability  of  the  A  exceeds  the  worst 
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Figure  4.1:  Synchronous  Stability  Plot,  Nominal  Gains. 

possible  destabilizing  effect  of  a  (the  BTP  mismatch).  Interestingly,  a  similar  syn¬ 
chronous  system  is  only  stable  for  some  r  values. 

One  should  not  equate  large  negative  values  of  a*  with  good  performance.  For 
example,  lightly  damped  estimator  error  states  can  be  perfectly  acceptable  when 
measurement  noise  is  small.  Increasing  the  damping  for  some  state  errors  may  only 
reduce  damping  of  the  output  errors.  Therefore,  a *  should  only  be  used  to  assess 
stability,  not  performance. 

The  next  Chapter  applies  these  stability  concepts  to  a  simple  system.  For  the 
remainder  of  this  report,  the  following  notational  abbreviations  will  be  used: 

A (r)  s  X(^(r)),  and 

<r(r)  s  cr(A(r)). 

This  yields  a  more  compact  notation  and  emphasizes  the  functional  relationship 
between  A(  ),  a(*),  and  r. 


log  (lambda)  £  log  (sigma) 
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Figure  4.2:  Asynchronous  Stability  Plot,  Nominal  Gains. 


Chapter  5 

Stability  Examples 


This  chapter  applies  the  sufficient  stability  condition  to  a  simple  double  integrator 
plant.  The  results  illustrate  various  stability  considerations  using  this  very  simple 
example. 


5.1  The  System 

The  system  consists  of  a  double  integrator  plant  with  digital  position  feedback 
and  a  crude  digital  rate  feedback  (See  Figure  5.1).  The  position  and  rate  feedback 
represent  two  coupled  but  independent  and  possibly  asynchronous  sample  processes. 
With  analog  state  feedback,  the  system  would  be  stable  with  any  positive  state 
feedback  gains.  The  asynchronous  digital  system  is  fourth  order  and  it  is  not  so 
well  behaved 

The  sample  periods  arc  Tl=T2=1.0  for  synchronous  cases  and  Tl=l,  T2-0.9 
for  asynchronous  cases.  The  so-called  asynchronous  case  is  actually  synchronous 
with  a  Bask:  Time  Period  (BTP)  of  9.0.  However,  all  cases  will  be  analyzed  with 
BTP  =  1.0.  This  fiction  allows  direct  comparison  with  an  exact  analysis  using  the 
true  synchronous  BTP. 

This  idea  of  using  asynchronous  analysis  and  a  short  BTP  for  a  synclirouous  sys¬ 
tem  lias  merit.  For  example,  suppose  some  system  were  synchronous  with  BTP =100 
but  we  arc  interested  in  the  response  during  a  much  shorter  time  (say  1).  Then,  it 
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Figure  5.1:  Block  Diagram  for  Example  System 

would  be  appropriate  to  analyze  the  system  with  a  email  DTP  (near  1)  to  evaluate 
the  short-term  stability  of  the  system. 

5.2  Nominal  Sampling 

At  the  nominal  condition,  both  samplers  operate  at  one  sample  per  second.  Fig¬ 
ure  4.1  shows  the  stability  condition  (Equation  4.9)  integrands  versus  phase  for  the 
nominal  gains  and  synchronous  sampling.  The  <r(A)  term  is  unity  so  logo(A)-0  for 
all  phase  values.  The  A  term  varies  with  phase.  The  system  is  stable  at  phase  condi¬ 
tions  greater  than  0.2S  and  unstable  for  pliase  conditions  less  than  0.28,  Therefore, 
the  stability  depends  on  the  phase  relationships  between  the  two  samplers.  This 
is  easy  to  understand  from  Figure  5.1.  When  the  rate  sampler  operates  just  after 
the  position  sampler,  the  effective  rate  feedback  gain  is  zero.  As  the  rate  sampler 
delay  (phase)  increases,  the  effective  rate  feedback  gain  increases  and  so  does  the 
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stability  until  the  delay  exceeds  a  quarter  of  the  natural  period  where  the  effective 
rate  feedback  gain  starts  to  decrease. 

5.3  Asynchronous  Sampling 

5.3.1  Analysis  for  BTP-  1 

Now  consider  the  case  where  the  rate  sampler  is  faster  with  a  period  of  0.9.  Ana¬ 
lyzing  this  configuration  for  the  same  BTP  (1.0)  gives  <r*  =  —0.031  and  the  curves 
in  Figure  4.2. 

The  A  curve  is  identical  to  the  synchronous  case  for  r  >  0.1.  The  events  in 
the  asynchronous  BTP  are  identical  to  the  synchronous  BTP  whenever  r  is  greater 
than  0.1;  but  the  asynchronous  BTP  contains  an  extra  rate  sample  when  r  is  less 
than  0.1. 

Since  the  sampling  is  actually  synchronous,  phase  (r)  is  not  uniformly  dis¬ 
tributed.  Actually,  r  cycles  through  a  sequence  of  ten  specific  values  (say  1.0, 
0.9,  0.8,  . . .  0.2,  0.1).  If  the  exact  phasing  is  known,  the  actual  values  can  be  aver¬ 
aged.  If  the  exact  phasing  is  random,  then  a *  is  a  good  stability  indicator  for  the 
synchronous  case  if  the  analysis  BTP  is  much  shorter  than  the  true  BTP. 

5.3.2  Analysis  for  Synchronous  BTP  (9.0) 

In  fact,  the  so-called  asynchronous  example  is  actually  synchronous.  We  use  this 
fact  to  determine  the  true  stability. 

Figure  5.2  shows  stability  integrands  for  the  true  BTP.  Comparing  with  the 
previous  plot,  we  see  the  sufficient  condition  was  conservative.  This  fact  is,  however, 
magnified  by  the  crude  synchronous  approximation  (1  »  0.9).  In  actual  practice, 
much  better  BTP’s  can  be  selected. 


logdowbdo)  &  log  (sigma) 
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Figure  5,2:  Stability  Plot,  Nominal  Gains,  Long  BTP 


Chapter  6 


Synchronous  Design  Method 


The  overall  design  method  is  a  gradient  search  to  minimize  a  scalar  cost  function. 
This  chapter  describes  the  cost  function,  the  gradient,  and  the  search  algorithm  for 
the  synchronous  sampling  case  wi;  h  known  phase.  The  next  chapter  extends  the 
method  to  synchronous  sampling  with  random  phase  and  to  the  asynchronous  case 
with  varying  phase. 


6.1  Cost  and  Gradient 

Actually,  two  different  cost  functions  are  needed:  one  for  an  unstable  system  and 
one  for  a  stable  system.  The  true  cost  function  must  approach  infinity  as  the  sys¬ 
tem  approaches  instability  because  an  unstable  system  is  not  acceptable  (infinitely 
bad).  However,  initial  guesses  for  the  control  gains  may  yield  an  unstable  system. 
Therefore,  an  always  finite,  alternate  cost  function  is  used  until  stabilizing  gains  are 
found. 

Ideally,  the  cost  function  is  an  analytic  function  of  the  BTP  STM.  At  a  minimum, 
the  cost  should  be  a  continuous  function  of  the  gains  with  a  gradient  defined  almost 
everywhere.  Isolated  gradient  discontinuities  are  acceptable  if  the  gradient  search 
is  not  likely  to  encounter  these  points. 
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6.1.1  Initial  Cost  Function 

The  initial  cost  function  must  decrease  as  the  system  becomes  more  stable.  An 
obvious  choice  is  the  spectral  radius  of  the  BTP  STM  since  stability  and  a  spectral 
radius  less  than  one  are  equivalent.  Unfortunately,  the  spectral  radius  gradient  is 
discontinuous  when  multiple  eigenvalues  are  equidistant  from  the  origin.  This  is  a 
serious  flaw  because  a  gradient  search  invariably  encounters  such  conditions  while 
minimizing  the  spectral  radius  of  a  high  order  system. 

The  initial  cost  function  chosen  is  a  variation  of  the  Ln  norm  of  the  eigenvalue 
vector.  The  initial  cost  was  defined  as 


l  =  £(*?*<)»  (6.1) 

i= 1 

where  k  is  the  order  of  the  system,  A<  is  an  eigenvalue  of  the  STM,  and  n  is  some 
even  integer.  As  n  increases,  this  cost  function  becomes  equivalent  to  using  the 
spectral  radius.  Typically,  larger  values  of  n  are  better  for  higher  order  problems. 
For  the  ninth-order  two-link  robot-arm  problem,  n  =  4  and  n  =  8  both  worked 
well.  The  gradient  of  this  cost  is  defined  whenever  partials  of  the  eigenvalues  exist. 
Although  the  gradient  is  discontinuous  at  repeated  roots,  such  points  are  rare  and 
caused  no  problems  for  the  test  cases. 


6.1.2  Initial  Gradient 

The  gradient  of  the  initial  cost  is  found  by  applying  the  chain  rule  to  Equation  6.1: 

i  =  rEd:A,)'1i2(A-A,  +  A:Ai).  (0.2) 

*  1=1 

The  eigenvalue  derivative  (A,)  is  computed  from  4*  and  'P  as  described  in  Ap¬ 
pendix  A.  Gradient  components  ore  computed  separately  for  each  variable  param¬ 
eter  in  the  controller. 
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6.1.3  Main  Cost  Function 


Once  a  stable  system  is  obtained,  the  cost  function,  as  introduced  in  Chapter  3,  is 
taken  as: 


E{2  BTpJo 
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for  a  system  disturbed  by  stationary  white  process  noise  for  the  infinite  past. 


Useful  Theorems  The  following  theorems  will  be  used  to  develop  the  cost  func¬ 
tion  expressions  (see  Appendix  D  for  proofs): 


Theorem  1  Let  xct  be  the  partial  state  vector:  [xj  xJ]T  such  that 

ict  =  [AB]  Xe,  +  nCM 

where  nc#  is  a  white,  continuous  process  noise  with  covariance: 

0 


"£(<)}  = 


"  “  |  <(»-<)  =  X“«(a-<) 


where  S(-)  is  a  unit  impulse  at  zero. 

If  xx(t)  =  and  there  are  no  discrete  transitions  between  t  »  0 

and  1 5=  ti,  then 

xx(U)  »  <i>(tx)xx(Q)<t>(ti)r  +  /Jc(<i) 


Where  <fr(s)  =  exp([A233-9)  and 


/««.)=  l"mxiMrds. 

Jo 


(6.3) 
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Theorem  2  Let  X  —  [xj  xj  xd]T  be  the  full  state  vector.  Let  be  a  discrete  state 
transition  matrix  where 

X(i*)  =  9JX(r)  +  ni(t) 

where  nd(t)  is  white  discrete  process  noise  with  covariance  Rd. 

If  XX (t)  =  E{X(t)XT(t)}  and  the  discrete  transition  ^Ild  occurs  at  time  t0, 
then 

XX{tt)  =  Vd  XX(to)  *  J  +  Ri.  (6.4) 


Note:  let  Rd  =  [Rij\-  Then  Rij  is  zero  unless  tyd  updates  state  i  or  state  j. 
Theorem  3  Let  X  be  the  full  state  vector:  [xj xj xd]T  and 

X  =  G{t)X  +  N{t). 

Where  G(t)  is  stable  with  a  corresponding  state  transition  matrix  $( t(, ,  ta).  N(t)  is 
white  process  noise  and  E{N(r)NT(s)}  =  6(r  —  s)Rn(s). 

Let  XX(t)  s  jE{X(<)Xt(<)},  <o  >  <-*  >  t-r  •  •,  and  limn_*..0O(tn)  =  -oo. 

Then  if  Rim  E{X(ti)XT(U)}  when  E{X(ti.l)XT(ti.i))  =  0  (i.e.  the  covari¬ 
ance  growth  from  U-\  to  U)  then 

~OQ 

«6s0 


Theorem  4  Let  X  be  the  state  vector:  (xf  xj  xd)T  such  that 


X  sa  GX  +  JV 


where  G  is  constant  and  N  is  white ,  stationary  process  noise  with  covariance 


xjj  0  0 
0  0  0 
0  0  0 


Let  XX(ti)  =  E{X(ti)XT(ti)}  and  Wo  be  a  symmetric  matrix. 
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If  there  are  no  discrete  transitions  between  time=  0  and  time=  t,  then 

J(i,  0)  =  e{J*  XT(r)W0X(r)dr} 

=  £(xX(Q)*J*<H(r)TWoV(r)dr} 

+  £(x°*J*£vT(a)WoV{8)dsdr?)  (6.5) 

where:  J(t,  0)  is  the  cost  contribution  for  the  segment  (0,  t),  denotes  element-by¬ 
element  matrix  multiplication ,  S  denotes  the  algebraic  sum  of  the  matrix  elements, 
A  B  0‘ 

0  0  0  t 
0  0  0 

Cost  Calculation  The  BTP  consists  of  continuous  time  segments  separated  by 
discrete  events.  The  discrete  events  do  not  contribute  directly  to  the  cost  inte¬ 
gral  because  they  occur  in  zero  time  and  the  states  are  always  finite.  Hence,  the 
cost  is  !  J(ti,ti-i)  where  J(m,n)  is  defined  in  Theorem  4  and  there  are  k 

continuous  segments  in  the  BTP.  Consider  the  second  term  in  Theorem  4: 

£  ( X c°  *  £  £  <bT(s)  W0V(a)ds  dr) 

This  term,  which  represents  the  cost  contribution  from  the  noise  in  the  current 
segment,  does  not  depend  on  the  discrete  ( DS )  gains  (the  other  term  represents 
the  cost  from  all  previous  noise).  For  simplicity,  tins  second  term  will  be  deleted 
entirely  from  the  cost  calculations.  The  rationale  is: 

•  The  value  of  the  deleted  terra  may  be  computed  [VL78]  but  this  is,  by  far, 
the  most  difficult  calculation  and  its  value  is  slight,  at  most. 

•  If  all  the  controls  are  digital  (all  adjustable  gains  in  DS  array),  then  the  deleted 
terra  is  constant  and  it  docs  not  influence  the  gain  optimization. 

•  With  some  analog  controls  (adjustable  gains  in  the  AB  array)  the  contribution 
of  this  term  will  be  small  unless  the  fastest  sample  period  is  long  compared 
to  the  emu'  decay  time  constant  (unlikely). 
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Using  this  simplification,  the  cost  can  be  approximated  as: 

2 -fifp  E  txx(u)  *  /J'4'  * (t)T  W„  *(<)  * 

or 

2WpttxX(u)*Qi 

where 

Q<=  lU+^(i)TW0m)dt  (6.6) 

Notice  that  is  always  defined  regardless  of  system  stability. 

The  XX(ti)  term  can  be  expanded  using  Theorem  3: 


i-i 


XX(U)  =  %0  XX(i0)  +  Y.  j  *fj 

i=i 


where  i?j  is  the  additional  state  covariance  from  the  end  of  the  j  —  l’th  segment  to 
the  end  of  the  j’th  segment  and  $mn  is  the  STM  horn  the  end  of  the  n’th  continuous 
segment  to  the  start  of  the  m’th  continuous  segment  and  n  =  0  indicates  the  start 
of  the  BTP. 

Then,  the  cost  becomes: 


Now,  use  the  symmetric  identity:  £(T  A'i  TT)  +  Xj  ~  t(Tr  X%  T)  *  X\  to  extract 
the  XX(to)  from  the  summation.  The  first  term  can  be  rewritten  as: 


1 


2  DTP 


xxw  *•£*&** 

ial  < 


1 

2  BTP 


£XX(to)*WW 


where 


k- 1 


WW  = 

ial 


(6.7) 


Notice  that  WW  is  always  defined. 

Suppose  the  additional  covariance  from  noise  in  the  current  BTP  is  accumulated 
recursively  in  XX  as  follows: 


1  «■  •*  *****  n*  n.'M  n  mftat  n  m  ttXUKVttvmtflt  tftnMtlftttMffttl 
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XXo  =  0, 

XX?  =  'ftuXXi  yjd  +  Wu  (reference  theorem  2),  and 
XXf  =  VicXX+^Z  +  /*+*  dt  (see  theorem  1). 

XX  =  XX£. 

Where  ^,c  is  the  i’th  continuous  STM  in  the  BTP,  is  the  subsequent  discrete 
STM,  and  there  are  k  continuous  segments  in  the  BTP.  The  subscripts  on  X  refer  to 
the  discrete  events  between  continuous  segments,  and  the  (-  +)  superscripts  indicate 
values  just  before  and  just  after  the  indicated  discrete  events.  These  XX  values 
will  be  used  to  simplify  the  cost  expression.  Note  that  the  XX  sequence  can  always 
be  calculated. 

Combining  these  expressions  gives: 

3  =  2Wpt[XXM  *  WW]  +  2 Ifp  ti t  *  <3il  ’  (6'8) 

Expressions  for  each  of  these  terms  have  been  defined  except  XX(to)  which  is 
addressed  now. 

XX  is  the  state  covariance  at  the  end  of  a  BTP  if  the  state  is  zero  at  the  BTP 
start.  XX(<o)  is  the  steady  state  covariance  at  the  start  of  the  BTP  if  the  system 
lias  been  excited  by  the  process  noise  forever.  Note  that  XX  always  exists  but 
XX (tQ)  only  exists  if  the  system  is  stable.  If  the  system  is  unstable,  the  steady 
state  covariance  is  infinite  and  the  initial  cost  function  must  be  used. 

For  synchronous  periodic  sampling  all  BTP  STM’s  (<P)  are  identical.  Using 
Theorem  3,  the  steady-state  state  covariance  at  BTP  start  (E{X(fo)-YT(to)})  can 
be  found  from  XX  and  the  BTP  STM.  When  the  BTP  STM  can  be  diagonalized, 
the  infinite  sum  is  solved  in  closed  form. 

XX(U>)  =  fS((0-l,)XX,i’r(!,-t0) 


(6.9) 
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Where: 


=  S^A*(S-1  XX  SrH)(Aa)*^Sa. 

=  5  (S'1  XX  S~H)  *  (£(A<A")‘‘)  Sh. 

=  5[(S-1JCXS'ff)*(j-f(f-  AA*))]s*. 


S,  A  = matrices  of  the  eigenvectors  and  eigenvalues  of  $  where  A  is  diagonal  and 
=  PAP"1, 

A  is  a  column  vector  of  the  eigenvalues  in  A, 

I  is  a  matrix  of  all  l’s, 

★  denotes  element-by-element  matrix  multiplication,  and 

4*  denotes  eleraent-by-element  matrix  division. 

Note  that  the  quantity  XX (to)  always  exists  for  a  stable  system;  however,  the 
closed  form  expression  of  Equation  6.9  only  applies  to  stable  systems  where  the 
DTP  STM  is  diagonalizable.  As  a  small,  but  useful,  extension,  if  the  STM  can¬ 
not  be  diagonalized  because  of  repeated  defective  eigenvalues  at  zero,  switching  to 
BTP’=k*BTP  (where  k-numbor  of  roots  at  zero)  will  yield  a  diagonalizable  STM. 
An  alternate  method  of  finding  XX (to)  is  to  solve  the  Liapunov  equation 

XX  (to)  =  VXXtto)*7  4*  XX. 

Which  merely  states  that  XX(t0)  is  the  steady  state  covariauce  at  the  start  of  each 
BTP. 

Recursions  Fortunately,  the  preceding  expressions  lend  themselves  to  orderly 
evaluation  through  a  series  of  recursive  relationships.  Accumulators  are  established 
for  XX,  WW,  and  YY ;  where  accumulates  the  BTP  STM  and  YY,  a  scalar, 
accumulates  the  second  term  in  Equation  0.8.  Starting  at  the  first  event  or  segment 
in  the  BTP,  with  the  corresponding  state  transition  matrix  (ip),  the  state  covariance 
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growth  R,  and  the  cost  weighting  integral  Q  are  computed  for  the  event  or  segment. 
Then,  the  accumulators  are  updated  using  the  recursion.  This  process  continues 
til  all  segments  and  discrete  events  are  included.  Then  XX(t0)  is  found  from 
Equation  6.9  (which  uses  the  modal  decomposition  of  '£)  and  cost  is  found  from 
Equation  6.8. 

The  initial  conditions  are:  $  =  I,  XX  =  0,  WW  =  0,  and  YY  =  0.  The 
recursions  are: 


YY 

=  yy  +  £xx*q , 

(6.10) 

XX 

=  il>XXtj;T+R, 

(6.11) 

WW 

=  WW+VTQ<S,  and 

(6.12) 

$ 

=  </>$. 

(6.13) 

Note  that  the  YY  update  must  precede  the  XX  update  and  the  WW  update  must 
precede  the  $  update.  Also,  Q  is  defined  by  Equation  6.6  for  analog  transitions 
and  Q  is  zero  for  discrete  transitions.  The  R  term  is  the  right  hand  term  in  Equa¬ 
tion  6.3  for  analog  transitions  and  the  right  hand  term  in  Equation  6.4  for  discrete 
transitions.  Notice  that  these  recursions  are  valid  and  stable  for  stable  and  unstable 
systems  and  for  defective  BTP  STM’s.  Therefore  a-priori  stability  knowledge  is  not 
required.  The  appropriate,  cost  function  can  be  selected  after  the  WW,  XX, 
and  YY  are  computed  and  the  spectral  radius  of  is  known.  Appendix  B  shows 
how  Q,  R,  and  $  arc  computed  for  continuous  segments. 

6.1.4  Gradient  of  Main  Cost  Function 

Define  ( )  as  the  partial  of  (  )  with  respect  to  any  of  the  adjustable  parameters. 

*  •  •  • 

When  the  gradient  is  required,  YY,  XX,  WW,  and  ^  are  computed  in  parallel 
with  YY,  XX,  WW,  and  Initial  conditions  for  YY,  XX,  WW,  and  are 
all  zero.  Parallel  recursions  for  YY,  XX,  WW,  and are  obtained  directly  by 
differentiating  Equations  6.10,  6.11,  6.12,  and  6.13: 

yy  =  rV  +  £(;rjf*Q  +  Jo-*<5), 

xx  =  <i>xx<i>T  +  <i,xxxi>T  +  <pxxtjjT  +  it, 


(6.14) 

(6.15) 
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WW  =  WW  +  VTQV  +  VTQ<$  +  yTQV,  and 
=  ij>  v  +  x{>  $ . 


(6.16) 

(6.17) 


Here  too,  the  recursions  must  be  performed  in  the  given  order.  The  expressions  for 
XX (to)  and  cost  are  also  differentiated  to  yield: 


XX(to)  = 
+ 
+ 
+ 


S[T1*T2]Sh 


TX+T2 
Tl*T  2 


SH 

SH 


S[T1+T2]SH. 


Where: 

T1  =S-lXXS~H, 

Tl  =  S~l  XX  S~H  +  5"1  XX  S-»  +  S-1  XX  S~w, 


(6.18) 


S'-1  m-S-lSS~\ 

T2  =  j>  (f-AAw),and 

T2  a  (Aah  -I-  AA*)  *T2*T2. 

Finally,  the  cost  expression  is  differentiated  to  yield: 

j  =  Yjffp  (£(A'A'((d)  .W  +  *  WW)  +  VV)  (6.19) 

These  partials  are  fonned  for  each  variable  parameter.  The  cigenderivatives  A 
and  S  are  computed  from  the  BTP  STM  (®)  and  its  partial  ($*)  (see  Appendix  B). 

6.2  Search  Algorithm 

The  gradient  search  process  begins  by  guessing  values  for  the  variable  gains  and 
installing  them  in  the  AD  and  DS  matrices.  Next,  the  BTP  STM  ($),  the  related 
parameters  ( WW ,  XX,  and  YY)  and  their  partials  (with  respect  to  each  variable 
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gain)  are  computed  for  the  specified  phasing.  The  main  cost  or  initial  cost  function  is 
selected  based  on  the  STM  spectral  radius.  The  cost  and  gradient  are  computed.  A 
Quasi-Newton  search  is  performed  using  the  gradient  and  the  Hessian.  The  Hessian 
is  initialized  at  identity  and  updated  with  the  Broyden-Goldfarb-Fletcher-Shanno 
update.  Finally,  the  minimum  along  the  search  direction  is  found  by  a  line  search 
using  a  parabolic  curve  fit  guarded  by  the  golden-section  step.  These  optimization 
methods  are  described  in  [GMW81]. 

The  computer  code  for  the  search  algorithm  assumes  that  the  system  is  unstable 
when  random  initial  gains  are  used  and  it  queries  the  operator  if  stored  gains  were 
used.  When  initial  gains  are  unknown,  random  values  may  be  used;  but  all-zero 
gains  should  be  avoided.  Setting  the  initial  gains  to  zero  may  produce  a  rare  singular 
condition  where  the  gradient  is  not  defined.  When  the  system  is  initially  assumed 
unstable,  the  algorithm  switches  to  the  main  cost  function  when  the  BTP  STM 
spectral  radius  drops  below  a  threshold  (e.g.  0.9).  When  a  search  step  produces  a 
marginally  stable  or  unstable  system  after  main  cost  function  is  selected,  the  cost 
routine  returns  a  large  positive  number  (1/eps  was  used).  The  system  is  treated  as 
unstable  whenever  max(X)  >  0.99.  Numerical  overflow  was  never  a  problem. 

The  actual  search  algorithm  code  (see  Appendix  E)  was  a  direct  implementation 
of  the  equations  given  in  {GMW81}. 
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Chapter  7 

Asynchronous  Design  Method 


The  vector  space  of  all  possible  phase  values  can  be  divided  into  a  finite  number  of  re¬ 
gions  where  the  BTP  STM  is  an  analytic  function  of  phase  (reference  Appendix  C). 
In  fact,  the  STM,  its  eigensystem,  and  the  related  quantities  (WW,  XX,  and  YY 
in  the  previous  chapter)  are  polynomials  of  phase  in  each  of  these  regions.  If  these 
regions  are  sufficiently  small,  a  second  order  polynomial  accurately  describes  the  re¬ 
lation  between  cost  and  phase.  This  polynomial  approximation  gives  a  simple  way 
of  addressing  the  synchronous  problem  with  unknown  phase  and,  through  that,  the 
asynchronous  problem. 


7.1  Synchronous  with  Random  Phase 

Suppose  we  have  a  system  with  two  independent  (not  synchronized)  sample  pro¬ 
cesses  with  synchronous  periods.  When  the  system  is  turned  on,  some  random 
phase  is  established  between  the  sample  processes  and  that  phase  remains  con¬ 
stant.  Hence,  the  system  is  synchronous  but  the  phase  is  random.  Assume  that  the 
initial  phase,  r,  is  uniformly  distributed  on  [0,T).  Let  J(0,r )  be  the  cost  function 
of  the  previous  chapter,  where  $  is  a  vector  of  the  variable  parameters.  J{9,  r)  is  a 
computable  scalar  that  is  uniquely  defined  for  each  6 ,  r  pair.  As  before,  the  cost 
function  is: 

fBTP  1  [T 

E Jo  XT(t)W0X(t)dt  =  j;Jo  J{$,t )ir 
35 
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where  the  second  integrand  represents  the  expectation  taken  over  r. 

Direct  numerical  integration  is  difficult  because  each  J(0,  r)  evaluation  requires 
a  great  deal  of  computation.  As  an  alternative,  the  region  [0,  T )  can  be  divided  into 
regions  where  J(0,  r )  is  continuous.  Then  J(8,t)  can  be  found  for  a  few  points  in 
each  region  and  J(0,  r)  can  be  modeled  as  a  polynomial  in  r  for  that  region.  This 
polynomial  is  easily  integrated  and  the  gradient  of  the  integral  is  easily  found  from 
the  gradients  of  «/(•)  at  the  same  sample  points. 

7.1.1  One  Random  Phase 

The  curve-fit  approach  applies  to  r’s  of  any  dimension,  but  the  rest  of  this  treatment 
will  deal  with  the  simple  case  of  one  sequence  with  random  phase.  From  here  on, 
r  €  [Q,T)  is  a  scalar.  In  this  case,  there  is  a  set  with  U  €  [0,T]  and 

i  w  1,,.  ,,fc  such  that  .7(0, r)  is  continuous  for  r  €  (U, t.+i).  Therefore,  J(-)  will  be 
approximated  as  a  parabola  in  each  region.  Note  that  J(6,  r)  may  be  ill  defined  at 
r  =  t,  (a  point  of  possible  discontinuity). 

Cost  and  Gradient 

Let  Jj,  Jj,  and  J3,  represent  the  cost:  J(0,  r)  evaluated  at  r5,  r2,  and  r3,  where: 


U  +  ti+i 

2=5  2  ' 

(7.1) 

n  -  <<  +  |(<»+i  -  <<)» 

(7.2) 

r3  =  <.'+1  -  |(*.+r  “  U) 

(7.3) 

where  e  is  a  safety  factor  to  insure  that  the  end  points  ore  actually  in  the  current 
interval.  In  the  interval  (f„  1),  the  cost  function  is  be  modeled  as: 

J(8,  x)  «  cx3  +  bx  +  a 

where  a  -  Jj,  b  —  (J3  —  Jj)/2,  and  c  —  (J3  -  2 3%  +  J\)/2,  For  simplicity,  r  is 
replaced  by  the  scaled  and  zero-shifted  dummy  variable  x  ,  where  x  =  0  corresponds 
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to  r  =  r2,  x  =  —1  corresponds  to  r  =  ri,  and  x  =  +1  corresponds  to  r  =  r3.  Using 
this  approximation,  the  contribution  to  the  cost  integral  is: 

Jt  +1  7(0,r)dr«(<i+1  -<j)(cr2/3  +  «)|*a1i-*  (7*4) 

Likewise,  for  each  gradient  component: 

j(6,x)  =  cs2  +  bx  +  a. 

where  a  =  b  =  (j3  -  Ji)/2,  and  c  =  ( j3  —  2J2  +  7i)/2.  So 

Jt  +1  j(0,T)dr  «  (f,+1  -  <«)(ci2/3  +  <2)1*=^-  (7-5) 

Finally,  the  total  estimated  cost  and  gradient  are  found  by  summing  the  contri¬ 
butions  from  each  region  and  dividing  by  T. 

7.1.2  Design  Algorithm 

The  design  approach  is  a  variation  of  the  method  for  synchronous  systems  with 
known  phase.  As  before,  the  first  step  is  to  guess  initial  values  for  the  variable 
control  gains.  Now,  however,  the  range  of  possible  phase  values  is  divided  into 
continuous  regions.  The  synchronous  cost  and  gradient  are  computed  at  the  center 
and  near  the  ends  of  each  region  using  exactly  the  same  method  as  before.  Then 
Equations  7.4  and  7.5  are  used  to  estimate  the  cost  and  gradient  in  each  continuous 
region  for  the  random  phase  problem.  The  contributions  from  each  interval  are 
summed  and  the  gradient  search  proceeds  as  before.  In  summary,  the  key  difference 
is  that  a  composite  cost  and  a  composite  gradient  are  used  instead  of  the  cost  and 
gradient  (for  one  specified  phase)  derived  in  the  last  chapter.  The  composite  coat 
and  gradient  for  random  phase  are  estimated  from  several  values  of  the  cost  and 
gradient  at  specified  phase  values. 

For  the  randora-pliase  problem,  there  will  always  be  at  least  one  continuous 
region;  but  there  may  be  many  regions  if  the  discrete  transition  matrices  do  not 
commute  and  the  BTP  contains  multiple  discrete  transitions  from  different  sample 
sequences.  Therefore,  many  cost  evaluations  (J(9,  r))  may  be  required  to  evaluate 
a  single  composite  cost  and  gradient. 
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Cost  function  selection  (main  or  initial)  is  similar  to  the  method  with  known 
phase  except  the  switch  from  the  initial  to  the  main  cost  cannot  be  made  until  all 
sample  points  (say  at  Ti,  t2,  and  r3)  represent  stable  systems.  The  code  implements 
the  switch  one  gradient  search  after  all  points  met  the  switch  criteria.  This  one-step- 
late  approach  was  necessary  to  avoid  storing  the  STM  data  ('if,  WW,  XX,  YY, 
and  their  partiais)  for  each  phase  value  until  all  the  STM’s  are  tested  for  stability. 


7.2  Asynchronous  Design 

The  asynchronous  design  method  is  exactly  the  same  as  the  method  for  synchronous 
systems  with  random  phase.  The  only  difference  is  that  the  designer  may  want  to 
specify  higher  process  noise  or  measurement  noise  for  the  true  asynchronous  case. 

The  rationale  for  using  the  random-synchronous  method  for  asynchronous  sam¬ 
pling  follows.  Judicious  selection  of  the  asynchronous  BTP  will  produce  consecutive 
BTP  STM’s  which  are  nearly  equal.  Small  STM  differences  are  simulated  by  addi¬ 
tional  process  noise. 

The  recommended  design  procedure  is  to  start  with  a  cost  function  based  on  a 
successful  continuous  design  method  such  as  a  good  LQG  design  with  a  continuous 
controller.  Then  use  the  synchronous  method  to  quickly  refine  the  discrete  gains 
at  some  arbitrary  phase.  Next,  use  the  random-synchronous  method  to  optimize 
the  gains  for  random  phasing.  Finally,  the  asynchronous  stability  condition  should 
be  used  to  evaluate  the  stability  of  the  resulting  design.  If  the  design  is  found 
wanting  (because  a( A)  is  too  large),  then  the  process  noise  in  the  asyncluonous 
states  should  be  increased  and  the  random-synchronous  method  repeated.  The  last 
gains  are  usually  a  good  starting  point  for  the  next  step. 


Chapter  8 

Design  Examples 


This  chapter  illustrates  controller  design  using  the  methods  developed  in  this  report. 

The  first  series  examines  the  double  integrator  system  of  Figure  5.1.  The  design 
procedure  is  applied  to  the  synchronous  and  asynchronous  examples  of  Chapter  5. 
Step  response  plots  and  stability  plots  (<r  and  A  vs.  r)  are  presented  for  each  set 
of  resulting  gains.  Finally,  the  asynchronous  sample  rate  is  varied  to  show  how  the 
cost  function  can  be  used  to  evaluate  sample  rate  effects. 

The  second  series  examines  the  two-link  robot  arm  of  [Ber86].  The  synchronous 
design  procedure  is  used  *o  illustrate  that  this  method  duplicates  the  original  result 
[Ber86].  Then,  a  new  asynchronous  sampling  case  is  considered. 


8.1  Double  Integrator  Examples 


The  states  are  numbered  as  shown  in  Figure  8.1.  The  parameters  for  all  double 
integrator  examples  are  summarized  in  Table  8.1.  Cost  weights  and  process  noise 
matrices  were  adjusted  by  trial  and  error  until  the  resulting  design  produced  a 
reasonable  step  response.  The  cost  weighting  and  noise  covariance  matrices  were: 
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PARAMETER 

Nominal 

Optimal  Synchronous 

Optimal  Asynchronous 

Cl 

0.500 

0.666 

1.121 

C2 

0.500 

0.115 

0.499 

C3 

2.000 

1.025 

1.628 

T1 

1.0 

1.0 

1.0 

T2 

1.0 

1.0 

0.9 

Table  8.1:  Parameters  for  Double  Integrator  Examples 


The  same  Wo  and  AT0  matrices  were  used  for  all  double  integrator  designs. 


Figure  8.1;  Block  Diagram  for  Double  Integrator  System 


8.1.1  Nominal  Case 

The  nominal  case  used  the  gains  from  Chapter  5:  cl=e2=0.5  and  c3=2.  These 
values  were  picked  at  random.  The  stability  plots  for  these  cases  were  presented  in 
Figures  4.1  and  4.2  of  Chapter  4.  The  step  responses  are  shown  below  in  Figures  8.2 
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and  8.3.  For  the  synchronous  sampling  case,  the  phase  was  1.0. 


Figure  8.2:  Step  Response:  Nominal  Gains,  Synchronous  Sampling 

Despite  good  stability  (see  Figure  4.1),  the  step  response  for  the  synchronous 
sampling  cose  is  poorly  damped.  Good  stability  as  indicated  by  the  a- A  plot  should 
not  be  confused  with  good  performance. 

The  step  response  with  asynchronous  sampling  (Figure  8.3)  shows  the  time- 
varying  nature  of  the  response.  The  damping  and  frequency  vary  (with  period=9). 
This  is  typical  time-varying  behavior  of  strongly -coupled  asynchronous  systems. 

8.1.2  Synchronous  Case 

The  desigu  procedure  was  used  for  the  synchronous  system  at  pliase:  r  =  l.  The 
optimal  gains  for  this  condition  were:  cl~0.666,  c2— 0.115  and  c3— 1.025.  The 
stability  plot  for  these  gains  with  synchronous  sampling  is  shown  in  Figure  8.4. 
The  system  is  guaranteed  stable  for  all  phase  conditions  except  for  a  small  range 
near  zero  (0  <  r  <  0.08).  The  synchronous  step  response  for  phose=1.0  is  shown  in 
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Figure  8.3:  Step  Response:  Nominal  Gains,  Asynchronous  Sampling 

Figure  8.5.  Overall,  the  stability  and  performance  are  good. 

Using  these  same  gains,  these  results  were  repeated  for  asynchronous  sampling. 
The  stability  plot  for  these  gains  with  asynchronous  sampling  is  shown  in  Figur  e  8.6. 
The  computed  a*  was  0.056  indicating  that  the  system  might  be  unstable  (although 
it  wasn’t).  The  step  resjxmse  with  asynchronous  sampling  is  shown  in  Figure  8.7. 
The  stability  and  performance  deteriorated  compared  to  the  optimal  (synchronous) 
design  point. 


8.1.3  Asynchronous  Case 

The  design  procedure  was  used  for  the  asynchronous  system.  The  optimal  gains  with 
asyncluonous  sampling  were:  cl— 1.121,  c2=0.490  and  c3=  1.628.  The  stability  plot 
for  these  gains  with  asyncluonous  sampling  is  shown  in  Figure  8.8.  The  computed 
<7*  —  0.061  so  the  system  is  not  guaranteed  to  be  stable.  Therefore,  the  stability 
test  was  repeated  using  a  better  approximation  of  synchronous  sampling  (the  exact 
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Figure  8.4:  Synchronous  Stability  Plot,  Synchronous  Gains 


Figure  8.5:  Step  Response:  Synchronous  Gains,  Synchronous  Sampling 
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Figure  8.6;  Asynchronous  Stability  Plot,  Synchronous  Gains 
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Figure  8.7:  Step  Response:  Synchronous  Gains,  Asynchronous  Sampling 
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BTP=9.0  was  used).  The  resulting  stability  plot  for  the  same  gains  with  BTP— 9.0 
is  shown  in  Figure  8.9.  The  asynchronous  step  response  is  shown  in  Figure  8.10. 
Overall,  the  stability  and  performance  were  good  but  not  as  good  as  the  synchronous 
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Figure  8.8:  Asynchronous  Stability  Plot,  Asynchronous  Gains 


Using  these  same  gains,  these  results  were  repeated  for  synchronous  sampling. 
The  stability  plot  for  these  gains  with  synelironous  sampling  is  shown  in  Figure  8.11. 
The  synelironous  step  response  for  phase- 1.0  is  shown  in  Figure  8.12.  The  stability 
and  performance  deteriorated  compared  to  the  optimal  asynchronous  design  point. 


8.1.4  Sample  Rate  Effects 


To  investigate  the  effect  of  sample  rate  selection,  the  period  of  the  asynchronous 
(rate  feedback)  sampler  was  varied  from  0.1  to  1.01  and  an  optimal  asynchronous 
design  was  performed  for  each  sample  rate.  The  minimum  cost  as  a  function  of 
sample  period  is  shown  in  Figure  8.13. 


l 


68 


Chapter  8.  Design  Examples 


Figure  8.13:  Optimal  Cost  as  a  Function  of  Sample  Rate 

Minimizing  the  cost  function  produced  good  controller  designs.  Therefore,  we 
might  use  these  minimum  costs  to  compare  the  goodness  of  different  sample  rates. 
The  figure  illustrates  the  diminishing  returns  when  one  sampler  becomes  much 
fester  tliau  the  other.  The  figure  also  illustrates  an  apparent  worst  case  when 
both  samplers  operate  at  almost  the  same  rate.  At  first  glance,  this  seems  to  be  a 
contradiction.  For  the  earlier  design  case  (see  Figure  8.4)  the  cost  was  only  about 
3.5.  Yet,  Figure  8.13  shows  the  cost  approaching  COO  for  the  synchronous  case. 

The  contradiction  is  easily  solved.  The  optimal  synchronous  design  case  was 
based  on  a  phase  (r)  of  1.0.  For  the  optimal  synchronous  (optimal  at  r  =  1.0) 
gains,  Figure  8  4  shows  that  the  plant  is  actually  unstable  at  other  values  of  r.  The 
cost  of  an  unstable  system  is  infinite.  Therefore,  when  the  asynchronous  design 
method  is  applied  with  sample  rates  approaching  synchronous,  the  design  at  most 
phase  conditions  was  compromised  to  achieve  stability  for  the  small,  previously 
unstable,  range  of  phase  conditions.  So  the  contradiction  is  solved.  The  design 
method  gives  the  conservative  result:  a  design  that  is  stable  (although  just  barely) 
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8.2  Two-Link  Arm  Examples 

A  more  realistic  example  is  used  now.  The  two-linlc  robot  arm  and  controller  of 
[Ber86]  is  used.  This  system  is  shown  in  Figure  8.14.  Two  sampling  configurations 
were  examined.  For  the  synchronous  configuration,  the  slow  samplers  (2\)  operated 
with  a  period  of  0.225  seconds  and  the  fast  samplers  (T2)  operated  eight  times  faster. 
For  the  asynchronous  configuration,  the  slow  samplers  operated  at  the  same  rate  but 
the  fast  samplers  operated  at  2i r  times  that  rate.  This  was  truly  asynchronous  (to 
the  computation  accuracy  of  the  machine).  The  cost  weighting  and  noise  covariance 
matrices  were  identical  to  those  in  [Ber86]: 

'2100000  000 

00000  0  0  00 

0  0  1850  0  0  0  0  0  0 

00000  0  0  00 

w0  =000010  000 

0  0  0  0  0  69.44  69.44  0  0 

0  0  0  0  0  69.44  69.44  0  0 

00000  0  0  00 

00000  0  0  00 

and 

'0  0  0  0  00000 

0  915.48  0  -2976.4  0  0  0  0  0 
0  0  0  0  00000 

0  -2976.4  0  14874.1  0  0  0  0  0 

X°=  0  0  0  0  10000 

0  0  0  0  00000 

0  0  0  0  00000 

0  0  0  0  00000 

0  0  0  0  00000 

The  same  Wo  and  X°  matrices  were  used  for  both  designs. 

The  parameters  for  the  two-link  arm  examples  are  summarized  in  Table  8.2. 
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The  two-link  arm  system  has  a  fairly  high  sample  rate  and  it  does  not  have 
strong  coupling  between  controllers.  The  resulting  asynchronous  system  performs 
well  at  all  gain/sampling  combinations,  but  the  best  performance  occurred  when 
the  design  gains  are  used  for  each  sample  condition. 


8.2.1  Nominal  Case 

The  new  synchronous  constrained  optimization  algorithm  was  applied  to  the  multi¬ 
rate  two-link  arm  system  of  [Ber86]  and  the  resulting  gains  were  identical  to  those 
published  in  [Ber86]. 

The  asynchronous  stability  plot  for  those  gains  is  shown  in  Figure  8.15.  This 
plot  shows  that  the  stability  is  totally  insensitive  to  sample  sequence  phase.  The 
corresponding  step  response  is  shown  in  Figure  8.16. 
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Figure  8.15:  Synchronous  Stability  Plot,  Synchronous  Gains 
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Figure  8.16:  Step  Response:  Synchronous  Gains,  Synchronous  Sampling 

8.2.2  Asynchronous  Case 

To  evaluate  asynchronous  sampling,  the  step  response  was  repeated  using  the  same 
gains  but  with  the  asynchronous  sampling  condition.  The  result  is  shown  Fig¬ 
ure  8.17.  The  step  response  is  somewhat  degraded. 

Some  step  response  degradation  resulted  from  the  overall  slower  sampling  rate 
and  from  the  mismatch  between  gains  and  sample  rates.  To  investigate  this,  the 
asynchronous  design  algorithm  was  used  to  find  a  new  set  of  optimal  gains  for 
the  asynchronous  sampling  condition.  The  resulting  gains  are  shown  in  Table  8.2. 
The  asynchronous  stability  plot  for  the  new  gains  is  shown  in  Figure  8.18.  The 
step  response  with  the  asynchronous  gains  and  asynchronous  sampling  is  shown 
on  Figure  8.19.  Except  for  a  slight  difference  in  initial  overshoot,  this  response  is 
nearly  identical  to  the  optimal  synchronous  response. 

Finally,  the  step  response  was  repeated  for  the  asynchronous  gains  and  the 
synchronous  sampling  condition  (see  Figure  8.20).  This  response  is  slightly  slower 
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Figure  8.17:  Step  Response:  Synchronous  Gains,  Asynchronous  Sampling 


Asynchronous  Sequence  Phase,  sec. 


Figure  8.18:  Asynchronous  Stability  Plot,  Asynchronous  Gains 
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Figure  8.19:  Step  Response:  Asynchronous  Gains,  Asynchronous  Sampling 

than  the  best  results  but  quite  good  overall. 

For  the  two-link  arm  system,  the  asynchronous  controller  is  nearly  as  good  as 
the  best  synchronous  controller. 


Chapter  9 


Practical  Considerations 


9.1  BTP  Selection 


For  the  asynchronous  case,  BTP  selection  is  left  to  the  designer.  There  are  an  infinite 
number  of  BTP  choices.  Long  BTP’s  provide  better  approximations  of  synchronous 
sampling  but  long  BTP’s  require  more  calculation  (for  $,  WW,  XX,  YY,  and  their 
partiala).  Furthermore,  even  slight  improvements  in  the  BTP  match  oventually 
require  large  increases  in  the  BTP.  Clearly,  this  is  a  diminishing  returns  situation. 
Incidentally,  the  design  method  is  not  compromised  by  long  BTP’s  (although  the 
computational  burden  is  high)  because  the  cost  is  the  true  continuous-time  integral 
of  the  weighted  mean  square  error.  However,  the  sufficient  stability  condition  only 
considers  errors  at  the  ends  of  BTP’s;  so  short  BTP’s  may  be  more  appropriate  for 
the  stability  test. 

The  following  rules  and  rationale  were  developed  to  guide  the  best  selection  from 
a  finite  number  of  alternatives.  Suppose  now,  that  the  designer  starts  with  a  list  of 
candidate  BTP’s.  For  example,  this  may  be  all  candidates  with  BTP’s  shorter  than 
one  minute.  Such  a  choice  would  be  reasonable  if  the  plant  time  constants  were  on 
the  order  of  a  minute. 
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9.1.1  Rule  of  Thumb 

Let  TijTji •  •  be  candidate  BTP’s  which  contain  ni,ri2, .  ..,n*  discrete  events 
and  which  have  consecutive  phase  slips  (i,  (2, . . £*.  The  best  BTP  is  the  one  with 
the  lowest  nj  *  Q  product. 

Consecutive  phase  slip  is  the  difference  in  phase  between  consecutive  BTP’s. 
Phase  is  defined  as  the  delay  from  the  start  of  the  BTP  to  the  start  of  the  asyn¬ 
chronous  sample  sequence.  The  other  sequence  is  called  the  synchronous  sequence 
because  it  is  synchronous  with  the  BTP. 


9.1.2  Rationale 


Recall  that  the  continuous-time  state  transition  matrix  for  elapsed  time  (  can  be 
computed  as: 


*(()“ 


e*- 


A  B 
0  0 


0 


0  * 
I 


Now  assume  that  £  is  small  so  this  can  be  approximated  by  the  first  two  terms  of 
the  series  expansion  for  the  exponential: 


4KCW  + 
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C  =  /4*ZC 


where  Z  is  defined  as  indicated. 

Lot  sequence  1  be  synchronous  with  the  BTP  whilo  the  sequence  2  phasing 
“slips”  by  C  from  one  BTP  to  the  next.  Suppose  we  expand  the  state  transition 
matrix  for  the  first  BTP  as: 


$»,  «  DtUMUr 

where  A  is  a  discrete  transition  in  sequence  1  and  II,  includes  all  the  continuous 
transitions  and  all  the  discrete  transitions  from  sequence  2.  Then  the  state  transition 
matrix  for  the  next  BTP  will  be 


=  A*(C)ni*(-C)A*(C)n3-  • 
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providing  that  none  of  the  sequence  1  discrete  transitions  transpose  with  sequence  2 
discrete  transitions.  Using  these  approximations  for  $  we  get: 

*  a  *  DX{I  +  ZO Hi(J  -  ZQD2{I  +  ZQUr  •  *nn.x(I  -  ZQDn(I  +  ZC)n»(I  -  ZQ 

=  ®i  +Cl  DxZ^DilLr  •  -I>n-inn_il>nnn 

— D\RxZD2Tl2'  •  •■Dn_iIIn_xDnnn 
:  (9.1) 

DiUiD^Tli'  •  •Dn-\Hn~iDnZlln 
—  DiIIiD2n2*  •  -D^nn-iDnZIIn] 

The  basis  of  the  asynchronous  analysis  and  design  approaches  is  successive  BTP 
state  transition  matrices  winch  are  nearly  equal.  This  means  that  the  last  term  in 
Equation  9.1  should  be  small.  We  cannot  say  much  about  this  term,  but  two  things 
are  clear.  First  (  multiplies  the  whole  thing  so  (  should  be  small.  Second,  the 
number  of  terms  in  the  brackets  is  proportional  to  the  number  of  discrete  events  in 
schedule  1  during  the  BTP.  So  the  number  of  discrete  synchronous  events  during 
the  BTP  should  be  small.  The  rule  of  thumb  follows  from  minimizing  the  product 
of  these  two  items. 

9.2  Asynchronous  Analysis  of  Synchronous  Sys¬ 
tems 

It  may  be  more  appropriate  to  design  and  analyze  a  synchronous  system  as  if  it  were 
asynchronous.  For  example,  assume  a  system  is  synchronous  but  the  real  BTP  is 
very  long  (much  longer  than  plant  time  constants). 

The  computations  would  be  much  easier  if  the  system  were  treated  as  asyn¬ 
chronous  with  a  shorter  BTP.  Furthermore,  we  arc  normally  interested  in  behavior 
during  time  intervals  much  shorter  than  the  BTP.  Although  state  errors  may  de¬ 
crease  over  the  whole  (long)  BTP,  they  may  grow  unacceptably  during  some  portions 
of  the  BTP  (i.e.  short  term  instability).  When  behavior  during  periods  shorter  than 
the  BTP  is  of  interest,  it  is  appropriate  to  use  a  short  “fake”  BTP  and  analyze  the 
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system  as  if  it  were  asynchronous.  In  this  case,  r  is  not  uniformly  distributed; 
rather,  it  assumes  a  finite  number  of  values  depending  on  the  initial  phasing  and 
sample  rate.  Hence,  only  a  few  evenly-spaces  the  points  on  the  stability  curves 
are  relevant.  Still,  <r*  and  the  A  and  a  curves  give  good  estimates  of  the  stability, 
particularly  if  the  exact  phasing  is  unknown. 


9.3  Accelerated  Convergence 

The  design  method  is  completely  automatic;  however,  some  manual  interaction 
can  accelerate  convergence  to  the  optimal  solution.  The  synchronous  optimization 
process  is  much  faster  (at  least  three  times  faster)  than  asynchronous  optimization. 
Consequently,  the  synchronous  method  should  be  used  with  some  representative 
phase  condition  to  find  initial  gains  for  the  asynchronous  optimization  process. 

The  asynchronous  optimization  search  cannot  switch  to  the  stable  cost  function 
until  stabilizing  gains  are  found  for  all  of  the  phase  conditions  (curve-fit  points). 
When  only  a  small  phase  region  is  unstable,  tins  search  can  be  very  slow  or  it  can 
stall  altogether.  This  is  usually  cured  by  one  or  two  synchronous  optimization  steps 
at  the  offending  phase  condition.  Alternatively,  if  there  are  several  small  disjoint 
unstable  regions,  the  power  in  the  initial  cost  function  can  be  increased.  Fourth 
and  eighth  powers  were  used  in  the  examples  but  these  can  be  increased  within  the 
numerical  precision  of  the  computing  hardware. 


9.4  Cost  Weighting  Matrices 

Choosing  good  noise  covariance  and  cost  weighting  matrices  is  not  simple.  (BcrS6) 
demonstrated  that  matrices  selected  to  produce  good  continuous-time  designs  also 
worked  well  for  the  muliirate  controllers.  Based  on  tins  and  the  relative  case  of 
continuous-time  design  methods,  these  matrices  may  be  developed  by  first  designing 
a  ugood”  continuous-time  LQG  controller  and  using  the  same  cost  and  covariance 
matrices  for  the  multirate  discrete  design. 


9.5.  Numerical  Properties 
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9.5  Numerical  Properties 

The  design  and  analysis  calculations  rely  on  two  matrix  operations  that  may  present 
numerical  problems.  These  are  spectral  factorization  and  matrix  exponentiation. 
While  these  two  matrix  functions  always  exist  (in  theory)  computing  their  values 
can  be  a  significant  numerical  problem.  The  codes  for  the  sample  problems  used 
PC-MATLAB  [MLBK85]  which  implements  the  EISPACK  algorithm  [SBD*Vo]  and 
the  Pade  approximation  algorithm  [MVL78].  One  attempt  to  use  another  matrix 
package  (which  used  an  eigensystem  approach  for  matrix  exponentiation)  was  un¬ 
reliable.  Any  implementation  of  the  methods  presented  in  this  paper  should  start 
with  fast  reliable  algorithms  for  these  two  matrix  functions. 

Maximum  System  Size 

Practically,  the  maximum  system  size  for  the  method  is  limited  by  the  numerical 
precision  of  the  various  mathematical  operations.  Assuming  tliat  the  BTP  is  rea¬ 
sonably  short,  the  various  STM  related  matrices  (4*,  WW,  XX ,  YYi  and  their 
partials)  can  be  computed  with  only  small  errors  since  matrix  multiplication  and 
addition  are  the  ouly  operations  involved.  Also,  the  closed-loop  system  eigenvector 
matrix  (complex)  must  be  inverted,  but  this  should  be  a  well-conditioned  matrix 
in  the  vicinity  of  the  optimal  gains  (otherwise,  S~l  XX  S~f1  in  equation  6.9  gives 
high  costs).  Other  inversion  processes  use  the  pseudo-inverse  so  ill  conditioning  is 
not  a  problem. 

With  no  analog  gaius  (in  .4  or  /?),  finding  the  Q  matrix  requires  exponentiating 
a  2(nc  -f  n,)  by  2(r»c  4-  n#)  matrix  where  nQ  is  the  number  of  continuous  states 
and  nt  is  the  number  of  sample  states.  If  there  are  variable  gains  in  the  .4  or  D 
matrices,  a  3(nc  -f  «,)  by  3{nc  -f  nf )  matrix  most  be  exponentiated  to  find  Q.  Also, 
the  STM  eigensystem  (dimension  equals  number  of  states)  must  be  found  for  each 
gain/phase  condition  evaluated.  The  ability  to  accurately  find  these  transcendental 
matrix  functions  limits  the  size  of  the  system  these  methods  can  handle. 

No  attempt  was  made  to  quantitatively  determine  the  maximum  system  size 
as  a  function  of  algoritluu  accuracy.  The  PC-MATLAB  routines  use  the  1EEG 
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standard  arithmetic  in  the  8087  numeric  coprocessor.  Each  real  value  is  64  bits 
(52  for  the  mantissa).  Unusual  behavior  attributable  to  numeric  problems  was  not 
encountered. 


9.6  PC-MATLAB  Implementation 

PC-MATLAB  was  an  excellent  vehicle  for  developing  the  prototype  algorithm.  The 
compile  and  execute  speed  were  good,  but  more  importantly,  the  high-level  MAT- 
LAB  language  allowed  very  rapid,  reliable  code  development.  Furthermore,  the  code 
is  quite  readable.  MATLAB’s  modularity  and  consistency  checks  assisted  code  de¬ 
bugging  significantly.  However  these  very  strengths  created  limitations  that  could 
be  significant  if  execution  speed  and  storage  efficiency  arc  paramount  considerations. 

Pointers  and  Tables 

PC-MATLAB  executes  built-in  functions  (like  matrix  exponentiation  and  modal  de¬ 
composition)  very  quickly  but  logical  constructs  (“for”  loops  or  wif"  loops)  execute 
slowly.  Therefore,  brute-force  calculations  were  often  used  in  place  of  seemingly 
more  efficient  constructs.  For  example,  in  PC-MATLAB,  it  was  much  faster  to  re¬ 
compute  a  frequently-used  matrix  exponential  than  it  was  to  branch  to  a  subroutine 
for  table  look-up.  Similarly,  it  was  faster  to  store  a  sparse  matrix  and  multiply  by 
the  whole  matrix  than  to  use  pointers  to  the  few  non-zero  elements.  For  implemen¬ 
tation  in  some  other  compiled  language,  significant  speed  and  storage  improvements 
may  be  obtained  through  the  use  of  pointers  and  table  look-ups. 


9.6.1  Square  Root  Algorithms 

Several  symmetric  matrices  (UrlF,  XX,  and  the  Hessian)  are  propagated  using 
updates  of  the  form: 

z.tl~m,rr  +  Y, 

where  Y  and  Z  arc  symmetric  and  non-negative  definite.  Tins  is  the  same  form  as 
the  Kalman  Filter  covariance  propagation  cquatiou.  That  suggests  using  a  square 
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root  algorithm  [Kai81]  [BH75]  to  accomplish  the  propagation.  This  was  not  at¬ 
tempted  in  the  prototype  code  because  MATLAB  only  deals  with  rectangular  ma¬ 
trices  and  “definiteness”  problems  were  not  encountered.  Therefore,  there  was  no 
storage  or  computational  advantage  to  implementing  the  square  root  algorithm  in 
the  PC-MATLAB  code.  However,  implementations  in  compiled  languages  that  can 
exploit  the  storage  and  computational  advantages  of  triangular  matrices  would  ben¬ 
efit  from  a  square  root  propagation  algorithm. 
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Chapter  10 


Summary  and  Recommendations 


10.1  Summary 

A  sufficient  asynchronous  stability  condition  was  developed.  The  figure  of  merit 
describes  an  exponential  envelope  which  bounds  the  worst-case  average  state  error 
history  for  any  initial  condition.  The  figure  of  merit  is  found  through  numerical 
integration  of  quantities  computed  from  the  system  state  transition  matrix.  The 
integrands  have  useful  physical  interpretations. 

The  Constrained  Optimization  Method  of  Berg  [Ber86]  was  generalized  and 
reformulated.  The  resulting  method  is  more  efficient,  it  avoids  numerical  overflow 
problems,  and  it  includes  discrete  measurement  noise.  The  reformulated  method 
was  shown  to  replicate  Berg's  results. 

The  reformulated  constrained  optimization  method  was  extended  to  the  syn¬ 
chronous  sampling  case  with  random  phasing.  This  extended  approach  produced 
satisfactory  controllers  for  several  asynchronous  sampling  cases. 

10.2  Recommendations  for  Future  Research 

Recoding  the  method  in  a  compiled  language  is  tedious  but  could  provide  substantial 
speed  and  storage  improvements.  An  improved  linear  search  algorithm  should  give 
an  immediate  speed  improvement.  The  other  approaches  listed  in  the  last  chapter 
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(square  root  algorithms  and  table  look-ups)  should  also  provide  more  speed. 

Modal  decomposition  accuracy  and  matrix  exponentiation  accuracy  appear  to 
be  the  limiting  factors  on  system  size.  This  relationship  could  be  explored  to  find 
the  practical  limits  of  the  method. 

The  robustness  with  respect  to  sample  rate,  controller  gain,  and  plant  uncer¬ 
tainty  should  be  investigated.  Designs  resulting  from  this  method  should  have  good 
robustness  since  they  minimize  a  continuous  LQR  cost  function  and  continuous  LQR 
designs  have  desirable  robustness  properties.  However,  nothing  is  actually  known 
about  the  robustness  properties  of  these  designs  except  that  the  cost  gradient  is 
zero  (with  respect  to  the  gains). 

Methods  of  selecting  sample  rates  should  be  investigated.  All  existing  design 
methods  begin  with  specified  sample  rates.  If  some  equivalence  between  controller 
computational  operations  and  cost  function  is  specified,  then  an  optimal  sample 
rate  should  exist. 

.  Methods  of  selecting  the  cost  function  weights  and  process  noise  should  be  inves¬ 
tigated.  Existing  design  methods  begin  with  specified  values  for  these  matrices  (W0 
and  AT0  in  this  paper).  Berg  [Ber86]  suggested  using  a  satisfactory  continuous  LQR 
design  as  the  basis  for  the  diagonal  blocks  and  this  seems  to  work  well.  However, 
use  of  the  off-diagonal  blocks  to  avoid  saturation  may  merit  further  investigation, 

Methods  of  balancing  the  eigenvector  matrix  should  be  investigated.  The  suffi¬ 
cient  stability  condition  is  sensitive  to  the  scaling  of  the  BTP  STM  ($)  eigenvectors. 
This  also  affects  the  numerical  precision  of  the  design  algorithm.  The  optimal  scal¬ 
ing  could  be  investigated. 

Methods  of  extending  the  method  to  systems  with  defective  and  ill-conditioned 
BTP  STM’s  should  be  investigated.  The  design  method  used  the  modal  decom¬ 
position  as  a  convenient  way  to  solve  the  Liapunov  equation  for  the  steady-state 
covariance.  However,  the  steady-state  covariance  exists  for  all  stable  systems.  Con¬ 
sequently,  the  method  should  extend  to  all  cases  given  another  solution  to  the 
Liapunov  equation. 


Appendix  A 

Eigensystem  Derivatives 


This  appendix  develops  formulas  for  the  first  partial  derivatives  of  a  matrix  eigen¬ 
value  and  eigenvector  as  a  function  of  the  matrix,  its  eigenvalue,  its  eigenvector, 
and  the  first  partial  derivative  of  the  matrix. 


A.l  Problem  Statement 


Consider  any  non-defective  real  n  by  n  matrix  Z.  Let  be  an  isolated  non-zero 
eigenvalue  and  a,  the  corresponding  eigenvector. 

Since  Z  is  not  defective,  it  can  be  factored: 

Z  »  SAS“*  (A.l) 

where  S  —  [ai*-‘Sj***3,,J  w  a  matrix  of  the  n  independent  eigenvectors  and  A  — 
diag[Af  *  \i-  •  *A„]  is  a  diagonal  matrix  of  the  corresponding  eigenvalues  in  the  same 
order. 

Since  A,  and  a*  are  an  eigen-pair: 


Z >3 1  S3  A,J, 


(A.2) 


by  definition.  Also,  the  norm  of  a*  is  arbitrary  so  choose  ||s;||3  =  1  for  convenience. 
Suppose  Z  is  actually  Z(a)  where  a  is  some  scalar.  Define 

±  Q2  t  $X i  ,  .  da, 

z=a?Ai=^’“d*=&r- 
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Then,  the  problem  is  to  compute  A;  and  given  Z,  Z,  Aj,  and  s<. 

Since  the  norm  of  s,-  is  arbitrary,  let 

3?  Si  =  1  (A.3) 

where  the  “H”  superscript  indicates  the  conjugate  transpose  (Hermetian).  Differ¬ 
entiating  with  respect  to  a  gives  +  s^s,-  =  0  or 

%{s?3i)  =  =  0  (A.4) 

This  means  that,  for  a  constant-length  eigenvector,  i,  can  be  expressed  as  s,-  = 
sj-  +  j^Si  where  bf-  is  in  the  orthogonal  complement  subspace  of  s<  so  s^bf  —  0, 
j  =  \/-T,  and  7  is  some  real  constant. 


A. 2  Equation  Development 

Start  by  differentiating  Equation  A.2  with  respect  to  a: 

Z&i  4*  Zsi  —  -f  Aiij,  (A.5) 

Observe  that  the  right-hand  side  is  already  divided  into  a  component  in  the  s,- 
dircction  and  a  part  in  the  subspace  where  resides.  Pro-multiplying  both  sides 
by  sf  and  solving  for  A,: 

kt^tfZtu  +  aViZ-Xil)*. 

Observe  tliat  Sj  is  in  the  null  space  of  (Z-  A<I)  so  if  i,-  —  bf  4-J7«i*  only  bf  influences 
Ai  and  7  is  irrelevant.  Using  this  fact,  we  can  simplify  the  equation  somewhat: 

A,  «  sfZsi  +  s”(Z  -  Ail,*,1  t*  sfZsi  +  s“Zbf.  (A.6) 

Now,  prc-multiply  Equation  A.5  by  (T—  SiS?)  to  project  into  the  orthogonal 
complement  subspace  of  a; 


(I  -  9i9^)Z3i  4- (I  —  )Zbi  =  Ai(I  -  3i3i)bi 
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which  can  be  regrouped  as 

(I  -  »ta? )Z$i  =  (I  -  Si3?)[\il  -  Z]{sf  +  hsi)  =  [AJ  -  (I  -  *s?  )Z)sf .  (A.7) 

The  unique  solution  is  given  by 

if  =  (A, -I  -  (I  -  M?)Z]-'(I  -  •*?)&«  (A.8) 

if  the  matrix  [A, I  -  (I  -  is  not  singular.  This  non-singularity  requirement 

will  be  explored  further  in  the  last  section. 

If  Equation  A.8  has  a  unique  solution,  then  it  can  be  used  to  compute  if  and 
that  result  can  be  used  in  Equation  A.6  to  compute  the  respective  A,.  If  A,-  and 
s,  are  available,  calculations  require  solving  one  set  of  complex  linear  simultaneous 
equations  (of  form  Ax  =s  6),  four  complex  vector-matrix  multiplications  and  five 
complex  vector  products. 

A.2.1  Eigenvector  Derivatives 

The  eigenvector  derivatives  may  require  an  extra  step  because  i;  =  if  4-  jysi  and 
7  is  still  unknown.  For  a*  real,  Si  will  also  be  real  so  7  is  zero.  Hence,  i,\=  if  for 
real  eigenvectors. 

For  complex  eigenvectors,  the  solution  requires  separate  consideration  of  the  real 
or  imaginary  parts.  The  real  part  of  Equation  A.5  can  be  written: 

Zv  4*  Z($(af  )  -  7 to)  ss  (rv  -  uno  4-  <r(8i(if )  “*  7W)  +  ■<»<■)  +  W>)> 

where  =  v  4-  ju)  and  A  cr  4-  ju>.  But  7  is  the  only  unknown  (v,  tv,  er,  or,  w,  u>, 
and  if*  are  known).  Therefore 

[Z  -  &l]v  4*  uu>  +  [2  -  *I]8(if )  -  u/3(af )  =  7([Z  -  rf)**  +  wu)  (A. 9) 

where  everything  is  known  except  the  real  scalar  7.  Any  non-zero  component  is 
sufficient  to  compute  7.  In  practice,  the  vector  ([Z -oljty-f  u>t/)  should  be  computed 
and  the  largest  component  should  be  used  to  find  7.  Then  only  the  corresponding 
component  of  (Z  -  od]v  -f  Cjw  4*  [Z  -  <rI]K{if )  -  u>$(if)  ueed  be  computed.  The 
extra  work  to  find  7  is  one  real  matrix-vector  product  and  two  real  vector  products. 
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A.3  The  Singularity  Condition 

Theorem  5  The  matrix  [A<I  —  (I  —  Sjsf*)#]  is  not  singular  when  A i  is  a  distinct 
non-zero  eigenvalue  and  Z  is  not  defective. 


Proof:  Since  Z  is  not  defective,  Equation  A.l  can  be  used  to  factor  Z  giving 

[\il-SkS’l+3iS?SAS-1]. 

This  matrix  is  non-singular  if  all  the  eigenvalues  are  non-zero.  To  see  the  eigenval¬ 
ues,  apply  a  similarity  transformation  by  post-multiplying  by  S  and  pre-multiplying 
by  S~x.  Since  Z  is  not  defective,  S  is  invertible,  and  the  eigenvalues  are  invariant 
under  the  invertible  similarity  transform.  After  canceling  S~lS  terms,  where  ap¬ 
propriate 

[Ail-A  +  S-'wfSA]. 

.  Consider  the  term:  S“1s<s[/SA.  This  can  be  resolved  as  follows 

S  S3 

s? S  »  (/?»,*•  •  •&-!.<,  1,  •  •£*,<] 

where  e,  is  a  unit  vector  in  the  i’th  direction  and  hi  is  the  inner  product  between 
s,  and  sjf  (always  <  1).  So 

0  0  0  0  0 


S-'s^SA 


0  0  0  0  ...  0 

hi  *  *  *  Kfln.i 

0  •  •  •  0  0  0  *  •  •  0 


0  0  0  0  ...  o 

Now  add  this  to  the  two  diagonal  arrays:  A;I  -  A  for  the  following  result: 


5“1(A,I-(I-s,s!/)2]S  = 
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Ai-Ai 


0  0  0  •••  0 


0 

Ai/?i,» 

0 


•  •  •  A,-  —  A,_i  0  0 

A*— — it*  A,  A,+i/3,+1>i 

♦  •  •  0  0  A<  —  Al+1 


0 

An/3n,i 

0 


(A.10) 


t  0  0  0  0  •••  A,-  —  An  J 

By  inspection,  the  matrix  is  non-singular  when  all  the  diagonal  elements  are  non¬ 
zero.  In  fact,  the  diagonal  elements  (A<  —  A*,  *  •  •,  A,-  —  A<_i,  A<,  A i  —  A»+i,  •  •  •,  A,  —  A„) 
are  the  eigenvalues.  So  the  necessary  and  sufficient  conditions  for  non-singularity 
are:  A,-  /  0  andAj  ^  A;  for  all  j  ^  i. 

This  completes  the  proof  but  it  is  interesting  to  consider  A;  =  0  further.  If  A,  =  0 
the  null  space  of  the  matrix  on  the  right  side  of  Equation  A.  10  is  e„  By  reversing 
the  similarity  transform,  we  see  that  the  null  space  of  the  original  matrix  (when 
A,  ss  0)  is  a;,  the  eigenvector  of  Z  corresponding  to  A<.  Since  we  already  know  that 
is  orthogonal  to  a,-  the  fact  that  is  a  null  space  of  [A, I  -  (I  -  s.-sf*)#)  makes 
absolutely  no  difference  in  Equation  A. 7.  Therefore,  Equation  A.8  is  still  correct 
if  the  pseudo  inverse  (which  has  columns  orthogonal  to  a,)  is  used  in  place  of  the 
ordinary  inverse. 
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Appendix  B 

Discrete  Conversion 


In  Chapter  6,  the  quantities  $,  Q,  and  R  were  defined  for  continuous  transitions 
with  no  discrete  events.  Methods  arc  developed  here  for  computing  Qt  R,  and 
their  partial  derivatives  with  respect  to  a  scalar  variation  in  the  state  differential 
equation  matrix.  These  results  are  based  on  Van  Loan's  work  [VL78]. 


B.l  Problem  Statement 

Assume  a  linear,  time  invariant  continuous  system  described  by  matrix  state  equa¬ 
tion  ie  a  Are  t  Bx,  where  xc  is  the  continuous  part  of  the  state  vector  (which  is 
changing)  and  x,  is  the  sample  and  hold  part  of  the  state  vector  (which  is  constant). 
For  convenience,  A  and  B  are  grouped  into  a  single  matrix: 


2 


A  B 
0  0 


Let  A  and  B  be  a  function  of  a  scalar  a  such  tliat 


M 

9a 

1 

3a 

S3 

A 

B  ' 

0 

0 

J 

0 

0 

The  desired  results  are  expressions  for  the  matrices  <J>,  Q,  and  R  defined  earlier 
(see  Equations  3.3,  6.6,  and  6.3).  For  efficiency,  the  following  abbreviated  forms 
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and  their  partials  will  actually  be  calculated: 


$(<)  =  exp(Z  t), 

(B.l) 

S 

II 

(B.2) 

Rc(t)=f  xxx  <t>(a)T  da>  and 

Jo 

(B.3) 

Q(<)  =  /‘$(s)rWM$(s)ds, 

Jo 

(B.4) 

where  xxx  is  the  continuous  process  noise  covariance  matrix  and  Wc,  is  the  top  left 
corner  of  the  cost  weighting  matrix  (for  the  continuous  and  hold  states).  To  obtain 
the  correct  form  for  the  Chapter  6  expressions,  the  rightmost  columns  and  bottom 
rows  must  be  added  to  get  the  correct  size  matrix.  R  should  be  filled  with  zeros,  $ 
shoul  be  filled  with  an  identity  matrix,  and  Q  should  be  filled  with  W0t. 

Also,  we  need  the  partial  of  <&,  Q,  and  R  with  respect  to  a  scalar  a.  All  these 
partials  should  be  right  filled  and  bottom  filled  with  zeros  to  obtain  the  correct 
sizes. 

B.2  Van  Loan  Results 

Van  Loan  [VL7SJ  proved  the  following:  If 

A,  By  C,  ' 

C—  0  Ai  B2 
0  0  M 

is  a  block  triangular  matrix  of  constants  and 

F»(*)  Gj(t)  Ht(t)  ' 
ciCt)  -  0  Fi(t)  Gt(t)  , 

0  0  F,(f) 

then: 

FM)  =  (D.5) 

Gj(l)=  ami  (D.6) 

JO 

f' i+  /*  (‘  ***-•'  Bj+t  c****  dr ds.  (B.7) 

Jo  Jq  Jo 
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\-ZT 

0  ' 

m 

Gi(t) 

BiM  ' 

o 

II 

o 

(0 

z 

z 

and  =  0 

m 

Gi(t) 

L  0 

0 

z 

[  0 

0 

W) . 

Then: 


$(()  =  F,(«)  = 

= Gi{t)' 

Q(t )  =  F2(t)Gi(t),  and 

^  =  f?(Off.(«)  +  [ifMtf.Wf  ■ 


(B.8) 

(B.9) 

(B.10) 

(B.11) 


Parallel  results  are  obtained  for  R  by  replacing  Z  with  AT  and  Wca  with  x®v 


-A  x°n  0  Fi(t)  Gi(t)  Hi(t) 

Let  Cr  =  0  AT  AT  and  =  0  F2(t )  G2(t) 


0  AT 


Then: 


m 


Rc(t)  =  F2(t)Gi(t),  and 

=  F?WM  +  |Ffwa.wr 

If  only  is  required,  it  can  be  found  from 

*=[2  !l 


(B.12) 

(B.13) 


evw’’'  = 


Z 

%  « 
z 

0 

z 

ez‘ 

8ezt 

dot 

0 

ezt 

(B.14) 


When  partials  are  not  required,  Q  and  R  are  found  using  the  top  left  two-by-two 
blockii  of  Cq  and  Cr  in  Equations  B.10  and  B.12.  This  simplifies  the  calculations 
for  cases  without  variable  parameters  in  the  A  or  B  matrices. 


B.4  Proofs 

Equations  B.8,  B.10,  and  B.12  follow  directly  from  the  definitions  and  from  Van 
Loan’s  results  in  Equations  B.5  and  B.6. 
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B.4.1  $  Partial 

$  has  a  series  expansion: 


Z2t 2  ZH 3 


(B.15) 


where  Equation  B.15  is  the  ordinary  expansion  of  a  matrix  exponential. 

The  series  expansion  of  the  partial  of  $  with  respect  to  a  is  found  by  differen¬ 
tiating  Equation  B.15  term  by  term: 


da 


(. ZZ  +  ZZ)t 2  (. ZZ 2  +  ZZZ  +  Z2Z)f 


2! 


Compare  this  with: 


■  + 


exp 


3! 


+ 


(B.16) 


Z  Z 

0  z 


Expand  the  first  few  terms  of  the  exponential  series  for: 


i;  o 

o  i 


+ 


z  z 
0  z 


t+ 


Z2  (ZZ  +  ZZ) 


0 


z 3 


21 


The  top  right  block  in  the  first  few  terms  certainly  match  the  desired  result.  We 
will  prove  that  the  top  right  block  is  the  desired  result  by  induction.  Assume  the 
the  matrix  part  of  the  fc’th  terra  of  the  series  expansion  is  given  by: 

Zh  (Zk-1Z  +  Zh-2ZZ  +  '"  +  ZZk~i)  1 
0  Zk 


Then  the  next  (Jb  4- 1)  term  will  be: 

Zk  (Zk‘xZ  +  Zk-2ZZ  +  »-  +  ZZk~l)  1 

0  zk 


z  z 
0  z 


Zk+X  (Zk2!  +  Zk“lZZ  +  ‘--  +  ZZk) 

0  z*+> 

So,  we  have  proved  by  induction  that: 

exp(Z() 

0  exp (Zt)  J 


-([:?]•)= 


(0.17) 
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Compare  this  with  Equation  B.6  for  A\  =  A%  —  Z ,  Bi  —  Z ,  and  —  $2  —  A3  —  0 
and  we  can  also  conclude  that 

=  [*  t2(t-s)  ££  ez«  ^  _  f*  ez(t-»)  z  ez*  da.  (B.18) 

da  Jo  da  Jo 

At  this  point,  direct  comparison  with  Equation  B.6  confirms  Equation  B.9.  So, 
Equations  B.D  and  B.14  are  proved. 


B.4.2  Q  and  R  Partials 

Equations  B.ll  and  B.13  are  duals  so  only  one  of  them  need  be  proved.  Equa¬ 
tion  B.ll  will  be  proved  since  its  notation  closely  parallels  the  previous  section. 
Begin  by  taking  the  partial  differential  of  the  Q(t)  definition  with  respect  to  a: 

em 


da 


Now,  substitute  Equation  B.18  for  the  partials  to  obtain: 

222  =  f'nsfWc  I*  ez<-T)ZeZr  dr  da  (B.19) 

da  Jo  Jo 

+  /‘  f  e**v  ZT  ezT(*'f>  dr  *(a)  da. 

Jo  Jo 

Recognize  that  the  second  integral  is  the  transpose  of  the  first  and  that  the  first 
is  equal  to  F$  (t)Hi(t)  from  Equation  B.7  with  C  =  Cq.  This  completes  the  proof. 
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Appendix  B.  Discrete  Conversion 


Appendix  C 
STM  Continuity 


C.l  The  Phase  Condition 

Consider  an  asynchronous  hybrid  linear  system.  Such  a  system  includes  a  linear, 
time  invariant  continuous  part  with  two  or  more  asynchronous  sample  processes. 
A  basic  time  period  is  established  (perhaps  arbitrarily)  and  this  establishes  a  time 
window  of  interest.  Let  all  the  sample  schedules  be  phase  locked  to  the  BTP  except 
one  that  is  allowed  to  slide  with  respect  to  the  BTP.  Figure  C.l  illustrates  this 
setup. 

Suppose  the  state  transition  matrix  (STM)  for  the  BTP  is  expanded  as: 


V  =  Vk  Sfc-i  V k-i’  •  **3  S2  V2  Si  Vi  So 

where  V\  is  the  STM  from  the  start  of  the  BTP  to  the  first  event  in  the  sliding 
sequence,  S\  is  the  STM  for  the  first  discrete  event  in  the  sliding  sequence,  etc. 

Now,  allow  all  the  events  in  the  sliding  sequence  to  slip  At  into  the  future  where 
At  is  small  enough  that: 

1.  None  of  the  events  in  the  sliding  sequence  leave  or  enter  the  BTP,  and 

2.  None  of  the  events  in  the  sliding  sequence  meet  or  reverse  order  with  events 
in  any  of  the  other  sequences. 
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Appendix  C.  STM  Continuity 


Tx 


Key  Sequence 

— BTP - 


time 


(~T 

i—r2  — 

2  2  2 

1  I  1 


2  2  2 

J _ t _ L 


time 


Sliding  Sequence 


Figure  C.l:  Phase  Relationships 

Then,  the  BTP  STM  for  the  slipped  sequence  can  be  written  as 

$( slip )  =  #(~  At)  Si-i  $(At)  ¥*_!•  •  >$2  $(-A t)  S\  $(A t)  ^i 

where  $(  At)  =  exp (Z  At)  is  the  continuous  state  transition  matrix  for  an  elapsed 
time  At. 

Since  $(  A t)  is  a  continuous,  analytic  function  of  t  (a  matrix  polynomial  in  fact), 
and  all  the  other  matrices  are  constant,  $  is  clearly  a  continuous  analytic  function 
of  the  slip. 

Since  this  slip  is  synonymous  with  the  phase  (r<)  of  one  of  the  asynchronous 
sequences,  the  BTP  STM  is  seen  to  be  continuous  and  analytic  with  respect  to  the 
phase  vector  as  long  as  the  two  conditions  are  met. 

The  total  phase  space  can  be  partitioned  into  regions  where  $  is  continuous 
simply  by  finding  the  boundaries.  So  the  problem  is  to  identify  all  the  delays  r 
where  r<  €  [0,  Tj)  such  that 

lim^r,-  -  e)  ^  4-  «) 

where  T;  is  the  period  of  the  asynchronous  schedule  and  $(r)  is  the  state  transition 
matrix  for  one  BTP  with  phasing  r.  The  easy  way  to  do  this  is  to  identify  each 
phase  value  where  either  of  the  two  conditions  occurs.  This  approach  may  find 
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C.2.  Boundary  Conditions 

discontinuity  boundaries  where  the  STM  is  actually  continuous,  but  that  is  not  a 
problem. 

C.2  Boundary  Conditions 

There  are  two  conditions  that  can  produce  an  STM  discontinuity:  first,  when  a 
discrete  event  enters  or  leaves  the  current  BTP,  and  second,  when  discrete  events 
reverse  order.  These  will  be  considered  one  at  a  time. 

For  the  rest  of  the  discussion,  it  is  assumed  that  there  is  only  one  asynchronous 
sequence  with  period  T. 

C.2.1  BTP  Truncation  Cases 

Let  p  be  the  remainder  when  the  BTP  is  divided  by  T.  Tliat  is  to  say,  BTP  =  kT+p, 
where  k  is  an  integer  and  p  <  T.  Then,  the  BTP  contains  k  complete  periods  of 
the  asynchronous  schedule  when  r  6  (0,  p)  and  only  k  —  1  periods  when  r  6  (p,  T). 
It  is  unreasonable  to  expect  continuity  when  the  number  of  complete  cycles  in  the 
BTP  changes,  so  r,  is  a  candidate  discontinuity  point  if: 

n  =  p  -  tk  or  r<  >a  T  -  tkP  (C.l) 

where  &,  is  the  time  from  the  start  of  the  asynchronous  schedule  to  the  k' th  discrete 
event  in  that  schedule. 

C.2.2  Commutivity  Cases 

Suppose  there  is  a  value  r,  such  that  a  discrete  event  in  synchronous  schedule 
coincides  (in  time)  with  a  discrete  event  in  the  asynchronous  schedule.  Furthermore, 
suppose  the  coincidence  occurs  during  the  BTP  at  r  -  r,.  Then  the  order  of  the  two 
discrete  state  transition  matrices  will  be  reversed  in  -  e)  and  $(r, +6)>  If  these 

two  discrete  state  transition  matrices  do  not  commute,  then  U  is  a  discontinuity 
point. 
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This  condition  can  be  described  mathematically  as: 


T\  4-  iij  <  BTP,  and  k\T\  +  =  Tx  +  k2T2  +  £2*  and  D\jD2k  ^  DikDij  (C.2) 


where 

k\,  k2  are  any  integers, 

T\  is  the  period  of  the  synchronous  schedule, 

T2  is  the  period  of  the  asynchronous  schedule, 

£1  j  is  the  time  from  the  start  of  the  synchronous  schedule  to  the  j’th  discrete  event 
in  that  schedule, 

£2*  is  the  time  from  the  start  of  the  asynchronous  schedule  to  the  k'th  discrete 
event  in  that  schedule, 

D\j  is  the  state  transition  matrix  for  the  j’th  discrete  event  in  the  synchronous 
schedule,  and 

Dik  is  the  state  transition  matrix  for  the  Jfc’th  discrete  event  in  the  asynchronous 
schedule. 


C.2.3  Recap 

Equation  C.l  and  Equation  C.2  define  the  phase  of  all  potential  discontinuities  in 
the  current  BTP  state  transition  matrix.  The  actual  values  can  be  found  by  a 
simple  but  tedious  exhaustive  search. 

Discontinuities  in  the  previous  BTP  state  transition  matrix  can  be  found  by 
substituting  Tj  -  r  for  r  and  working  backwards  from  the  end  of  the  period  and 
BTP.  The  union  of  discontinuity  times  for  the  current  and  previous  BTP’s  is  a 
candidate  discontinuity  set  for  the  eigenvector  function 


Appendix  D 
Theorem  Proofs 

This  chapter  provides  proofs  of  the  four  theorems  used  in  Chapter  6. 

D.l  Notation  and  Definitions 

The  following  notation  is  common  to  the  proofs. 

•  x0(t)  ~  vector  of  the  continuous-time  states 

•  x,(<)  =3  vector  of  the  sample- and-hold  states 

•  2d(t)  =s  vector  of  the  discrete-time  states 

•  JC(<)  ss  the  full  state  vector  {sf  xf  sej]r 

•  XX(t)  ss  full  state  vector  covariance:  £{A(f)A'r(t)} 

•  t vc(t)  -  vector  of  the  continuous-time  process  noise 

•  w,(t)  =  vector  of  sampling  errors 

•  t vj(t)  ==  vector  of  discrete  state  update  noise 

•  na(t)  —  augmented  vector  of  continuous  process  noise  =  (t«J  0]r 

•  n,j(f)  =  vector  of  discrete  process  noise  =  (0  u)J  u/]* ]T 
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Appendix  D.  Theorem  Proofs 


•  N(t)  =  total  process  noise  vector 

•  W0(t)  =  state  error  weighting  matrix  for  cost  function 


D.2  Theorems  and  Proofs 


Theorem  1  Let  Xc*  be  the  partial  state  vector:  [ x f  xJ]T  suck  that 

®C*  =  [AB]  xct  +  nca 


where  nct  is  white  continuous  process  noise  with  covariance: 


£{n«(3)n£(<)} 


*?i  0 

0  0 


6(s  - 1)  =  -  0 


where  £(•)  is  a  unit  impulse  at  zero. 

If  x x(t)  =  -E{aCc*(t)a:^(<)}  and  there  are  no  discrete  transitions  between  t  =  0 
and  t  —  t\,  then 

xx(tx)  -  <}>(ti)xx(0)<f>(ti)T  +  Rc(ti) 


where  <t>(a)  5  exp([AB]«)  and 

Rc(h)=  f\(s)X°^(s)T  ds. 

JO 

Proof:  Prom  linear  system  theory,  for  t<t\, 

*«(<)  =»  <f>{i)xa(0)  +  /  MnM(s)<h. 

JO 

So, 

*i(()  =  E{^{t)x„(0)  +  f  <4(r)n„(r) rfr) 

(*L(0)*r(0  + 

The  process  noise  is  uncorrelated  with  the  initial  state  so  E{xct(s)nJt(t)  «  0  for  all 
s  <t.  Therefore,  the  cross  products  are  zero.  Evaluating  the  remaining  terms: 

=  ^(t)*x(0)$T(t) 
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and 

E{Jq  <j>(r)nci(r)  dr  jf  n^(s)<f>T (a)  ds 

=  E{Jq  Jq  <f>(r)nca(r)nJs(s)<f>T(s)drds} 

=  jf  <l>(r)JQ  E{nca(r)n^(a)}(f>T(3)dsdr 
=  JQ<f>(r)X°t<t>T(r)dr. 

Therefore, 

xx(t)  =  <j>(t)xx(0)<j>T(t)  +  f  <j>(r)Xct<f>T(r)  dr 

Jo 

Theorem  2  LetX  =  [xjf  xj"  xj]r  6e  tAe  /tt//  state  vector.  Let  'i!d  6e  a  discrete  state 
transition  matrix  where 

X(t+)  =  <l!dX(n  +  nd{t) 

and  where  nd(t)  is  white  discrete  process  noise  with  covariance  R^. 

If  XX (t)  s  E{X(t)XT(t)}  and  the  discrete  transition  occurs  at  time  to , 
then 

Note:  let  Rd  =  [ify].  Then  is  zero  unless  updates  state  i  or  state  j. 
Proof:  From  the  state  equation, 

XX(tt)  =  £{(**X(r)  +  nj)  (xr(r)»J  +  rtf)}. 

But  E(X(r)nJ(l„))  -  0  and  £{n,,(ti)rtf(fj)}  =  ShlU. 

So,  XX(tt)  =  <SdE{X(r)Xr(t-)M  +  F.M)  =  ViXXV)* J  +  Ri. 
Theorem  3  Let  X  be  the  full  jfaie  vector:  [xf  xf  xJ)T  and 

X~G(t)X  +  N{t). 

G(t )  is  stable  with  a  corresponding  state  transition  matrix  ^(4,  <0)«  N(t)  is  white 
process  noise  and  E{N(r)NT(s)}  =  5(r  -  s)iJn(s). 

Let  XX (t)  s  to  >  f-i  >  <-a*  •  •,  and  limH^^30(fH)  =  — oo. 
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Then  if  Ri  =  E{X(ti)XT(ti)}  when  E{X(ti^i)XT(t^i)}  =  0  (i.e.  the  covari¬ 
ance  growth  from  to  U)  then 

XX(t0)  =  2  *(*o,  U)Ri*(to,  ti)T. 

i=0 

Proof:  Let  be  some  time  in  the  past.  Them 

X(«o)-»(thU)X(U)+  f  «(io,r)JV(r)<ir 

J*-k 

or 

rU 

=  »(*o,  +  E  /  *(<o,r)W(r)<ir. 


XX(*o)  =  £{*(«<,,  <-.)X(t-*)XT(<-l,)'I>I(to,i-k)) 

+  J5{(  E ’/"  *(!c,r)iV(r)<ir).Y,'((-i)*T(io.(.*)} 

\  1=0  Jti -»  / 

+  £{*((„,  1-*)X(U)|  E1/1’ 

+  £{  £  f*  *( *o,r)N(r)dr  £  [/  NT(s)^T(to,a)da} 

<=o  i=o 

XX(<„)  =  ¥(M-i)i5{X(i-*)XT(U)}*T(lo,t-,) 

+  E  T  <Ht«,r)E{N(r)XT(U))Jr<6T(t0,t.i)) 

»a0 

+  *(fo,(-0  E  /"'  JS{Jf(«_*)JVir(a)}»!r(<o, *)<i» 

j=0  *,b-» 

-.(fc-1)  -(fc-1)  .j, 

+  E  E  /  *(*o.r)  /  £{^(r)Wr(J))4,'((0,J)i.</r. 

«=0  ;=0 

Observe  two  things.  First,  the  system  is  stable  so  E{X(t)XT(t)}  is  finite  and 
Um*-*00v^(<0,f-fc)£{X(t_fc)Xr(t„fc)},iI'r(toif-t)  =  0.  Second,  the  noise  is  uncorre- 
latcd  with  prior  noise  and  with  prior  states.  Therefore,  the  cross  contribution  from 
disjoint  intervals  is  zero,  i.e.  £?{lF(s)l|F:r(0}  —  0  when  a  and  t  belong  to  different 
intervals.  Therefore,  all  the  cross  product  (t  ^  j)  terms  are  zero. 
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So 


lim  XX(f0) 


53  Jt.  *  *T(*o,  r)  Jt '  *  E{N(r)NT(a)}'bT(t0,  a)  ds  dr 

E  /  ^(to,r)Rn{r)<iT(t0ir) dr. 


Each  $(to»t)  can  be  factored  as  ®(<o>  t)  so 


lim  XX(t0)  =  f  *(to,t*)f  r  *(ti,r)Rn(r)*T(tiyr)dt 

fc-°°  i?0  IA-> 

But  the  term  in  brackets  is  just  il„  as  defined  above. 

Theorem  4  £ei  X  6e  t/ie  state  vector:  (xj  xj  xj]r  such  that 

X~GX+N 


to/iere  G  is  constant  and  N  u  white  stationary  process  noise  with  covariance 


X? 


x°xx  0  0 
0  0  0 
0  0  0 


Let  XX(t,)  s  £?{X(t;)XT(t,)}  and  W'b  6e  a  symmetric  matrix. 

//  iAere  are  no  discrete  transition*  between  times  0  and  times  t,  then 


J(t,0)  s  E^j*  XT(r)W0X(r)dr} 

«  £(xX(0)*jfVr)TWotf(r)dr) 

+  £(x°*£j'*T(s)W0'i/(s)dsdr^ 


where  J(t,0)  i*  part  o/iAe  co*t  integral  for  the  segment  (0,  t),  ‘V*  denote*  element - 
by-element  matrix  multiplication,  £  denotes  the  algebraic  sum  of  the  matrix  clc- 


/ 

A  B  O' 

meats,  and  4(t)  =  exp 

0  0  0 

t 

c 

0  0  0 
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Proof:  From  linear  system  theory, 

X(t)  =  0)  +  /'  *(s)N{$)ds. 

Jo 

So, 

E{£  X(3)TWQX(s)ds} 

=  E{J*(xT(Q)VT(r)  +  jT  NT(s)*T{9)dsS)W0 
(*{r)X{ 0)  +  j'  'ib(u)N(u)duj  dr). 

But  X(0)  and  N(t)  are  uncorrelated  if  t  >  0  so  the  expected  value  of  the  cross 
products  is  zero.  Therefore, 

E{£  X($)TW0X(s)ds) 

=  E{£  XT(Q)*T(&)WQ*(a)X(0)da) 

+  £{  jf‘(jfr  NT{a)VT{s)da)w0(J*  *(u)iV(u)  du)  dr). 

In  the  first  term,  the  constant  X(t©)  can  be  brought  outside  the  integral. 

E{£  XT(0)*T($)WW(a)X$)  da} 

«  E{Xr(0)^J^T{a)Wo<d(a)dajX(0)) 

«  tfafo)*  J**T(a)W0*(a)dA. 

Likewise,  the  process  noise  is  stationary  and  the  expected  value  operation  will 
yield  a  constant.  Therefore,  it  too  can  be  moved  outside  the  inner  integrals  as 
follows.  For  the  other  term, 

E{J*  (J'  NT{a)<bT(a)  ds)  Wi,(  jf '  *{u)N(u)  du)  dr} 

=  £{/'  f  lr  NT{a)^T(a)W^{u)N(u)dudadr) 

J r=0  JinzQ 

=  £{/'  f  (f  S(jV(u)lVr(s))*(*T(s)m,4»(u))du>)dsdr} 

Jr=0  V«=0  VitaO  / 
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=  r  r  ( r  £E{N(u)NT(s))}*(<$T(s)W0y(u))du)dsdr} 

J r=0  J  4=0  '.•/ u=0  J 

=  f*  r  £X°*(yT(s)W0$(u))dsdr} 

J r=0  Ja=0  '  ' 

=  tx°*[*  r  *T(s)WoV(s)dsdr} 

J  r=0  J  «=0 

since  x°  is  a  constant  which  can  be  brought  outside  the  integrals. 
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Appendix  E 
Computer  Codes 


The  algorithms  for  stability  analysis  and  for  asynchronous  design  were  implemented 
in  PC-MATLAB  and  executed  on  an  IBM-PC  clone.  The  MATLAB  code  is  close 
to  ordinary  mathematical  expressions  and  it  is  commented  so  these  routines  should 
be  useful  without  additional  documentation.  These  same  codes  will  run  on  some 
Unix  machines  with  PRO-MATLAB  (a  Unix  version  of  MATLAB).  The  Unix  hosts 
(e.g.  Sun  3)  are  much  faster  than  the  PC. 

To  use  this  software,  load  all  the  u.mM  files  in  some  directory  where  PC-MATLAB 
will  run.  Then,  run  "matlab"  at  the  operating  system  prompt.  Then,  command 
either  "design"  or  "analyze"  at  the  MATLAB  prompt  "»".  Finally,  answer  the 
questions  (following  each  answer  with  a  RETURN). 

To  run  your  own  examples,  use  buildtla.n  or  builddin.n  as  a  guide  to  cre¬ 
ate  a  new  buildxxx.m  file  for  the  system  you  want  to  investigate.  Name  your  file 
buildtla.n  or  builddin.n  and  run  as  before.  Alternatively,  use  a  new  name  for 
your  buildsxx . n  file  and  patch  the  routines:  analyst .  a,  design .  m,  and  var  japt2 .  n 
(xxxthsta)  to  use  your  file  instead  of  builddin.n  or  buildtla.n. 

The  subroutines  are  arranged  in  three  groups: 

•  Utility  Subroutines  (may  be  called  by  analysis  or  design  routines) 

•  Analysis  Subroutines 

•  Design  Subroutines 
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E.l  Utility  Routines 


E.1.1  Build  Two-Link  Arm  System:  buildtla.m 

function  CAB , DS , seqptr , Theta , varptr , wO , xO , BTP , keyseq] =buildtla 
X 

X  Buildtla  loads  the  initial  system  description  for  Berg’s  two  link-arm 
X  plant/controller.  Final  data  from  Berg’s  Case  1  is  used. 

X 

X  Figure  and  table  numbers  refer  to  Berg’s  Thesis. 

X 


The  states  are: 


x(i):  hub  angle,  theta 
x(2):  hub  angle  rate,  theta  dot 
x(3):  tip  position,  delta 
x(4):  tip  speed,  delta  dot 
x(5):  sample  ft  hold  1  (hi) 
x(6):  sample  ft  hold  2  (h2) 
x(7):  sample  ft  hold  3  (h3) 
x(8):  slow  discrete  control  state,  cl 
x(9):  fast  discrete  control  state,  c2 


(see  fig  6.1) 


(see  fig  6.2) 


Set  sampling  times  (ref  table  6.3) 


fprintf(*\nLoading  two  link  era  plant/controller. \n* ) j 


keyseq»l;  X  the  sequence  that  is  the  basis  of  the  BPT 

STP-i/35.556;  X  short  time  period  (synchronous) 

LTP"8*STP  5  X  long  time  period 

XSTP>LTP/(2*pi);  X  short  tins  period  (asynchronous) 

BTP-LTP;  X  basic  time  period 

X - 

X 

X  'seqptr*  is  an  array  that  defines  the  sampling  sequences.  Seqptr  has 
X  a  row  for  each  synchronous  sample  sequence.  Bach  entry  in  a  row 
X  represents  a  continuous-time  or  discrete-time  state  transition. 

X  Positive  entries  represent  continuous  transitions  for  that  duration. 

X  Negative  integers  indicate  discrete-time  transitions  described  by  the 
X  corresponding  block  of  DS  (i.s.  -1  and  -2  for  this  problem).  A  zero 
X  (which  may  be  required  to  fill  the  rectangular  array)  represents  no 
X  transition.  The  first  element  in  a  row  is  the  first  element  in  the 
X  sequence  (chronological)  which  must  indicate  a  discrete  transition. 
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X  The  period  of  any  sequence  is  the  sum  of  the  non-negative  elements  in 
X  v»he  corresponding  row  of  "seqptr". 


seqptr»[-i,LTP;  X  slow  sample  cycle,  starts  with  Di,  period»LTP 

-2,STP];  X  fast  sample  cycle,  starts  with  D2,  period=STP 

X - 

X 

X  Theta  is  a  vector  of  the  variable  parameters.  These  elements 
X  must  be  the  same  as  their  definitions  in  varptr.  (ref  table  6.S) 


Theta" [-0 . 48499 

X  -(alpha-1) 

11.297 

X  beta- 11 

0.39316 

X  beta- 12 

-13.483 

X  gamma-11 

1.0708 

X  gamma- 12 

-0.55327 

X  -(alpha-2) 

0.097632 

X  beta-21 

13.439 

X  beta-22 

-0.12129 

X  gamma-21 

-16.865  ] 

X  gamma-22 

X - 

X 

X  "varptr"  is  an  array  that  defines  each  of  the  variables  in  "Theta". 

X  Each  "varptr"  row  contains  (type,  row,  column)  where: 

X  type  •  0  denotes  the  AB  matrix 

X  type  ■  j  (j  ■  positive  Integer)  denotes  the  j’th  block  of  DS. 

X  The  i*th  row  of  "varptr"  corresponds  to  the  i'th  variable  in  "Theta" 
X  which  belongs  in  (row, column)  of  the  indicated  matrix. 


varptr«[  1,8,8 

X  alpha- 1 

1.5,1 

X  beta- 11 

1,5.3 

X  beta- 12 

1.5,8 

X  gamma-11 

1,5,9 

X  gamma-12 

2,9,9 

X  alpha-2 

1.6,1 

X  beta-21 

2,7,3 

X  beta-22 

1,6,8 

X  gamma-21 

2,7,9j;  X  gamma-22 

X - - - 

X 

X  AB  is  a  concatination  of  the  usual,  continuous-time  +A  and  -B 
X  matrices  (AB«[A,-B]),  where  xdot  *  A  x  ♦  B  u)  which  is  zero-filled 
X  for  squareness.  Negative  feedback  is  achieved  by  negating  the  B 
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X  matrix.  All  sample-and-hold  states  ars  considered  to  be  inputs  so  B 
X  has  a  column  for  each  hold  state  and  these  columns  are  sequenced  like 
'/,  the  sample-and-hold  states.  An  all-zero  column  indicates  the 
X  corresponding  hold  state  doesn’t  drive  the  continuous  states.  If 
X  the  output  of  two  holds  is  summed  to  drive  a  physical  input,  B  will 
X  have  duplicate  columns.  This  approach  allows  the  continuous  state 
X  transition  matrix  for  time  "t"  (with  no  discrete  events  during  t) 

%  to  be  computed  as: 

X 

X  Psi(t)»  [expm(AB*t),  0;  0,  eye(nxd)] 

X 

%  where  nxd  ■  number  of  purely  discrete-time  states. 

X 

X  In  seqptr,  AB  (a  continuous- time  transition)  is  indicated  by  a 
X  positive  entry. 

X  In  varptr,  AB  elements  are  indicated  by  a  zero  in  column  1. 

X 

AB*  [0,  1,  0,  0, 

0,  0,  0,  0, 

0,  0,  0,  1, 

0,  0,  0 ,  0, 

0,  0,  0,  0, 

0,  0,  0,  0, 

0,  0,  0,  0, 

X - 

X 

X  "DS"  is  a  concatination  of  all  the  discrete  and  sample  state 
X  transition  matrices  (i.e.  DS*[dl,d2, . . .si, si, . . .])  in  any  order.  For 
X  the  TLA  problem,  dl  is  the  slow  discrete  transition  and  d2  is  the 
X  fast  state  transition.  The  fixed  elements  ars  loadsd  now.  Update  is 
X  called  later  (by  "check")  to  load  the  variable  elements  (Theta)  into 
X  DS  and  AB. 


0,  0, 
-(2.3684),  -(-22.934), 
0,  0, 
■(-1.1428),  -(121.69), 
0,  0, 
0,  0, 


0; 

-(-22.934); 

0; 

-(121.59); 
0; 
0; 


X  ref  eq  6.4-6.10 
X  and  table  6.1 


X  zero  fill  row 
X  zero  fill  row 


0, 


0, 


0] ;  X  zero  fill  row 


DS*[eye(9)  eye (9)]; 

DS(6,5)»0;  DS(6,6)*0;  DS(8,8)«0;  DS(8,i)-l{ 

DS(7,16)«0;  DS(9,18)*0;  DS(9,12)*t; 

X - - - 

X 

X  Define  cost  weighting  parameters  for  optimization 

X  state  error  weighting  coefficients  for  cost  function 

v0*[2i  00000000 

000000000 
0  0  I860  0  0  0  0  0  0 
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000000000 
000010000 
0  0  0  0  0  69.44  69.44  0  0 

0  0  0  0  0  69.44  69.44  0  0 

000000000 
0  0  0  0  0  0  0  0  0  ]; 

X  process  noise  covaraence  (future  use) 

x0=[0  00000000 

0  916.48  0  -2976.4  00000 

000000000 
0  -2976.4  0  14874.1  00000 

000000000 
000000000 
000000000 
000000000 
0  0  0  0  0  0  0  0  0  ]; 


X  special  code  to  check  sensitivity  to  semi-definite  10  ft  W0 
Xw0=*w0+l*eye(w0) ; 

Xx0*x0+l*eye(v0) ; 

X  end  of  special  test  code 

X - 

fprintfC*  Load  complete.  Berg  case  1  data  used.\n\n*)» 

return 

X  end  of  the  buildtla  function  $$$*$$$$*$$$$$$$$$$$$$$$**$*$$$$$$$$$$*$$ 


E.1.2  Build  Double  Integrator  System:  builddin.m 

function  (AB,DS, aeqptr , Theta , varptr ,v0,x0, BTP , keyaeq] “builddin 

X 

X  Builddin  loads  initial  system  description  for  the  double  integrator 
X  plant/controller,  see***  fourth-order  version  ****** 

X 

x - 

X 

X  The  states  are:  x(l):  first  integrator  output 

X  x(2):  second  integrator  output 

X  x(3) :  sample  and  hold  output  (proportional) 

X  x(4) :  sample  and  hold  output  (rate) 

X 


116 


Appendix  E.  Computer  Codes 


f printf ( * \nLoading  for  4th  order  double  integrator/controller. \n' ) ; 


X 


keyseq*l;  X  the  sequence  that  is  the  basis  of  the  BPT 

'/,keyseq*2;  X  the  sequence  that  is  the  basis  of  the  BPT 


STP-1.0; 

X  first  time  period 

XSTP-i.i; 

X  first  time  period 

XLTP-l.O; 

X  other  time  period 

XLTP-i.l; 

X  other  time  period 

LTP* . 9 ; 

X  other  time  period 

y,BTP»STT; 

X  basic  time  period 

XBTP-LTP; 

X  basic  time  period 

BTP-9; 

V 

X  basic  time  period 

/«  - - - - - - - - -  -  - - 

X  Theta  is  a  vector  of  the  variable  parameters.  The  order  of  these 

X  elements  must  be  the  same  as  their  definitions  in  varptr. 

Theta* [0.5; 

X  +(cl)  X  so-called  nominal  gains 

0.5; 

X  4(c2) 

2.0]; 

X  *(c3) 

X  Theta* [1.121; 

X  ♦  (cl)  X  optimal  asynchronous  gains 

X  0.499; 

X  *(c2) 

X  1.628]; 

X  *(c3) 

X  Theta* [0.666; 

X  +(cl)  X  optimal  synchronous  gains 

X  0.115; 

X  *Cc2) 

X  1.025]; 

v _ _ _ 

X  *(c3) 

X 

"seqptr"  is  an  array  that  defines  the  sampling  sequences.  Seqptr  has 
a  row  for  each  synchronous  sample  sequence.  Each  entry  in  a  row 
represents  a  continuous- tine  or  discrete-tine  state  transition. 
Positive  entries  represent  continuous  transitions  for  that  duration. 
Negative  integers  indicate  discrete-tine  transitions  described  by  the 
corresponding  block  of  DS  (i.e.  -1  and  -2  for  this  problem).  A  zero 
(which  may  be  required  to  fill  the  rectangular  array)  represents  no 
transition.  The  first  element  in  a  row  is  the  first  element  in  the 
sequence  (chronological)  which  must  indicate  a  discrete  transition. 
The  period  of  any  sequence  is  the  sun  of  the  non-negative  elements  in 


seqptr* [-1,STP,0; 


X  proportional  feedback  event 
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-2,-3,LTP];  X  rate  feedback  event 


X - 

X 

X  "varptr"  is  an  array  that  defines  each  of  the  variables  in  "Theta". 

X  Each  "varptr"  row  contains  (type,  row,  column)  where: 

X  type  »  0  denotes  the  AB  matrix 

X  type  «  j  (j  ■  positive  integer)  denotes  the  j’th  block  of  DS. 

X  The  i’th  row  of  "varptr"  corresponds  to  the  i’th  variable  in  "Theta" 
X  which  belongs  in  (row, column)  of  the  indicated  matrix. 

varptr«[  1,3,2;  X  cl 

2,4,2;  X  c2 

3,4,4  3;  X  c3 


X - 

X 

X  AB  is  a  concatination  of  the  usual,  continuous-time  +A  and  -B 
X  matrices  (AB-CA.-B],  where  xdot  ■  A  x  ♦  B  u)  which  is  zero-filled  for 
X  squareness.  Negative  feedback  is  achieved  by  negating  the  B  matrix. 

X  All  sample-and-hold  states  are  considered  to  be  inputs  so  B  has  a 
X  column  for  each  hold  state  and  these  columns  are  sequenced  like  the 
X  sample-and-hold  states.  An  all-zero  column  indicates  the 
X  corresponding  hold  state  doesn't  drive  the  continuous  states.  If 
X  the  output  of  two  holds  is  summed  to  drive  a  physical  input,  B  will 
X  have  duplicate  columns.  This  approach  allows  the  continuous  state 
X  transition  matrix  for  time  "t"  (with  no  discrete  events  during  t)  to 
X  be  computed  as: 

X 

X  Psi(t)"  Cexpm(AB*t),  0;  0,  eye(nxd)] 

X 

X  where  nxd  *  number  of  purely  discrete-time  states. 

X 

X  Xn  seqptr,  AB  (a  continuous-time  transition)  is  indicated  by  a 
X  positive  entry. 

X  In  varptr,  AB  elements  are  Indicated  by  a  zero  in  column  1. 

X 

AB-  CO,  0,  -1,  -i, 

1,  0,  0,  0, 

0,  0,  0,  0, 

0.  0,  0,  0  3; 

X - 

X 

X  "DS"  is  a  concatination  of  all  the  discrete  and  sample  state 
X  transition  matrices  (i.e.  DS-[dl,d2, . . .sl.sl, . . .])  in  any  order. 

X  For  the  DINT  problem,  position  feedback  discrete  state  transition  and 
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X  d2  Is  the  rate  feedback  state  transition.  The  fixed  elements  are 
X  loaded  now.  Update  is  called  later  to  load  the  variable  elements 
'/,  (theta)  into  DS  and  AB. 

DS*[eye(4)  eye (4)  eye (4)]; 

DS(3,1:4)=[0  1  0  03;  X  DS(3,i:4)»  [0  cl  0  0]  after  update 
DS(4,5:8)»[0  1  -1  0] ;  X  DS(4,5:8)»  [0  c2  -1  0]  after  update 
DS(4,9:12)*[0  0  0  -1];  X  DS(4,9:12>*  CO  0  0  c3]  after  update 


X - 

y. 

X  Define  cost  weighting  parameters  for  optimization 


X  state  error  weighting  coefficients  for  cost  function 


v0»[i 

0 

0 

0 


0  0  0 

10  0 
0  0.1  0 

0  0  0.1  ]; 


X  process  noise  covarience 

xd«[0  0  0  0 

0  10  0 
0  0  0.1  0 


X 


fprintfO  Load  complete.  \n\n’) ; 

return 


X  end  of  the  builddin  function  $$$11$))$*$$$$$$$$*$$*$$*$$$**$$$$$$$$$$* 


£.1.3  Check  Dimensional  Consistency:  check.m 

function  conats»check( AB,DS,aeqptr, theta, varptr,V,xO,BTP,keyueq) ; 

X 

fprintfC* Checking  dimensional  consistency  and  computing  Cconsts]  An*); 


X  'consts* 
X  * conste* 
X 

X  where: 

X  1. 
X  2. 
X  3. 


is  used  by  meat  other  functions, 
a  tnx , nxc , nxs , nDS , nvar , nvarc , nseq , s  eqlen , key seq , BTP , 
f astseq , trainlen , speriod] 

nx  “  total  number  of  states 

nxc  ■  number  of  continuous  states  (A  ie  nxc  by  nxc) 
nxs  ■  number  of  sample  and  hold  states  (B  is  nxc  by  nxs) 
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X  4.  nDS  »  number  of  blocks  in  DS 

X  5.  nvar  ■  number  of  variable  parameters 

X  6.  nvarc  ■  number  of  continuous  (i.e.  in  AB)  variable  parameters 

X  7.  nseq  *  number  of  sample  sequences 

X  8.  seqlen  *  length  of  longest  sequence 

%  9.  keyseq  *  index  of  sequence  synchronous  vith  BTP 

X  10.  BTP  »  basic  time  period 

%  11.  fastseq  »  index  to  shortest  sequence 

X  12.  trainlen  *  length  of  shorter  train 

%  13.  speriod  »  period  of  shortest  sequence 

%  Also:  nxd  ■  number  of  discrete  states  (nx  ■  nxc  +  nxs  +  nxd) 

X  ABwide  ■  nxc+nxs 

X  DSwide  *  nxs+nxd 

X  phirow  ■  block  index  to  last  row  (phi’s)  in  pc.phi  arrray 

X  m  is  a  dummy  variable 
consts*zeros (1 , 13) ; 

Cconsts(l) ,m]»size(DS) ; 
consts(4)»fix(m/consts(l)); 

if  rem(m,consts(l)) ,  errmsgC  ERROR,  extra/missing  DS  columns.’);  end; 
Cm, ABwide] *size(AB) ; 

if  m"«ABwide,  errmsgC’DATA  ERROR,  AB  matrix  isnt  square.’);  end; 
consts (2) »max (f ind (any ( AB ’ ) ) ) ; 
consts (3) «ABwide-consta (2) ; 

[consts (5) ,m] -size (varptr) ; 

if  nf»3,  errmsgCDATA  ERROR,  varptr  does  not  have  3  columns.’);  end; 
if  coasts (6) “■length(theta),errmsg(’ ERR,  theta  varptr  mismatch.*) ;end; 
consts  (6)  -sum  ( (varptr  ( : ,  1>»0)  ) ; 

[consts (7) .consts (8)] -size (seqptr) ; 

if  consts(8)<2,  errmsgC ERROR,  longest  sequence  has  1  event.’);  end; 

X  check  "varptr"  consistency 
for  i«l : consts (5) , 

if  varptr (i,l)<0,  errmsgC'DATA  ERROR,  varptr(i.l)  is  negative.’);  end; 
select»abs(varptr(i , i) ) ; 

if  8elect>consts(4) ,  errmsgC ERROR,  varptr(i.l)  >  DS  size.’);  end; 

if  remCselect,!)'^,  errmsgC  ERROR,  varptr(l,l)  not  integer.’);  end; 

row«varptr(i,2) ;  co>  varptr  (i,  3); 

if  rov<l,  errmsgCDATA  ERROR,  varptr(i,2)  <«0. ’) ;  end; 

if  coKl,  errmsgCDATA  ERROR,  varptr(i,3)  <«0.’);  end; 

if  8elect««0, 

if  row>consts(2) ,  errmsgCDATA,  varptr(i,2)  exceeds  AB  size.’);  end; 
if  col>ABwide,  errmsgCDATA,  varptr(i,3)  exceeds  AB  sizo.*);  end; 
else, 

if  row>consts(l) ,  errmsgCDATA,  varptr(i,2)  exceeds  DS  size.*);  end; 
if  eol>eonsts(l)*consts(4),  errmsgC’ varptr (i, 3)  exceeds  DS.*);end; 
end;  X  end  if  eelect«*0-else 
end;  X  and  for* loop 
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consts(9)*keyseq;  X  sequence  synched  with  BTP 

consts(10)=BTP;  X  BTP 

X  compute  data  for  train  calculations 
etimes=seqptr.*(seqptr>0) ;  X  elapsed  time  increments 

periods^sumCetimes’) ;  X  periods  of  sequences  (row) 

[consts(13) ,consta<ll)]»min<periods) ;  X  shortest  period 
etimes(consts(ll) , :)»zeros(l,consts(8)) ;X  zero-out  short  sequence 
bigno»max(max(etimes)) ;  X  largest  element 

etimes«etimes+bigno*(etimes*»0) ;  X  set  all  the  zeros  to  bigno 

etamin(min(etimes)) ;  X  shortest  etime  in  slower  sequences 

consts(12)«fix(min(et/consts(i3))-l) ;  X  minimum  cycles  in  train 

consts(12)*max([i  consta(12)]) ;  X  avoid  zero  length  train 

consts(12)»consts(12)*consta(13) ;  X  minimum  train  length  (time) 

fprintf (’  Check  complete. \n\n’ ) ; 

X  end  of  procedure  check  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ 


E.1.4  Install  Gains  in  System:  update.m 

function  CAB,  DS]  ■  update (AB,DS,vars,varptr,consts); 

X 

X  This  function  updates  the  AB  and  DS  matrices  to  reflect  the  *new* 

X  parameters  in  ’ vara ’ .  Also,  if  AB  is  changed,  reset  is  set  to  one; 

X  otherwise  it  is  zero. 

nx*consts(i);  X  total  number  of  states 

nvar«conets(6) ;  X  number  of  variable  parameters 

for  i«l:nvar, 
aelect«abe(varptr(i,l)) ; 
row«varptr(i,2);  col»varptr(i,3) ; 
if  select*«0, 

if  AB(rov,col)a«vars(i),  AB(rov,col)«vars(i) ;  end; 
else, 

DS(rowf((select-l)*nx*col))»vars(i); 
end;  X  end  if-else 

end;  X  end  tor-loop 

x  end  of  update  function 


E.1.5  Find  Phase  of  #  Discontinuities:  cases. m 

function  Cctimes]*cases(flag,DS,seqptr,consts) ; 
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X 

X  This  function  computes  tha  phase  dal ay  tiaa  boundaries  which  partition 
X  tha  sample  schedule  offset  (tau)  into  regions  of  continuous  Psi(tau). 
X  It  flag-0  the  continuity  of  the  current  Pai(k.tau)  is  considered.  If 
X  flag-1,  the  continuity  of  Psi(k-l,tau)  of  the  following  BTP  is 
X  considered  too. 

X  ’ctimes’»[0]  if  naeq-1.  ctimas- [0  tau-max]  if  otherwise  synchronous. 

X  *********************************************** 

X  **  Ibis  version  is  limited  to  nseq-1  or  2.  ** 

%  *********************************************** 


fprintf (’Finding  all  continuous  regions  ...  *); 


nx-constaCl) ; 
nseq»conBts(7) ; 
seqlen-conats(8) ; 
keyseq-consta (9) ; 
BTP-consts(lO) ; 
tol-l.Qe-10; 


X  total  number  of  states 
X  number  of  sample  sequences 
X  length  of  longest  sequence 
X  Index  to  sequence  synchronous  with  BTP 
X  basic  time  period 
X  tolerance  for  same  event  times 


varaeq-3-keysaq ; 


X  index  to  async  sequence  (keyseq-1  ■>  varaeq-2) 


if  (flag~-l)A(flag‘’«0) ,  errmsgCflag  out  of  range  in  cases.');  end; 
if  naeq"«i;  cti»*s»[0] ;  return;  end;  X  single  sequence  case 
if  nseq>2,  errmsgC 'EXECUTION  ERROR,  More  than  2  sequences.’);  end; 
if  keyseq>2,  errmsgC’ EXECUTION  ERROR,  KEYSEQ  more  than  2.  ’);  end; 
if  keyaeq<l,  errmsgC ’EXECUTION  ERROR,  KEYSEQ  less  than  1.’);  end; 

etimes-Cseqptr  .*  (seqptr>0));  X  elapsed  time  intervals 

period«aum(etimee*);  X  periods  of  sequences 

cyclss (keyseq) «f i x (BTP/psriod (keyssq) ) ; 

if  remCBTP, period (keyssq) )'*0,  errmsgC’ Key  Sequence  is  Async.’);  end; 
cycles (v*rseq)*fix(BTP/pariod(v*rssq));  X  max  •  full  cycles  in  BTP 

seqrem-rsmCBTP.periodCvarstq));  X  remainder 

of  full  cycle*  in  BTP 
X  starting  points  (min  tau) 

X  all  aaquencss  synchronous 
X  currant  BTP  looses  1  cycle 
X  previous  BTP  gains  ons  cycle 


X  end  point  (max  tau) 
X  cases  where  discrete  transitions  don’t  commute 


X  cases  with  different  numbers 
c times* [0] ; 

Xif  seqrem— 0,  return;  end; 
crimes'*  Cctimes  .seqrem) ; 
if  flag«l; 

temp»rea(2*eeqrem, period(verseq) ) ; 
ctiaes- [c times , temp) ; 
end; 

ctimes*Cctimes.period(varseq)) ; 
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X  Test  all  cases  where: 

%  il*period(keyseq)+etimes (keyseq, jl)  ■ 

X  i2*period ( varseq) ♦etimes( varseq, 1 2) +tau  <  BTP 

X 

X  where:  il,i2,jl,j2  ■  non-negative  integers  ft  0  <  tau  <  period (varseq) . 

lim_kl*0;  lixa..ku»fix(  (flag+i)  *BTP /period  (keyseq)  ) ; 
lim.vl=0;  lim_vu*f ix((flag+l)*BTP/period(varseq)) ; 


lor  il*~linO&:lim_ku, 
tk=il*period (keyseq) ; 
for  ji»l:seqlen, 
if  etimesCkeyseq, jl)>«0, 
tk*tk+et imes (keyseq , j 1 ) ; 
if  (tk>0)ft(tk<(flag+l)*BTP) ; 
for  i2*lio_vl:lin.vu, 
tv*i2*period (varseq) ; 
for  j2*i:aeqlen, 
if  etiraea (varseq, j2)>»0, 
tv*tv+et ines (varseq , j  2) ; 
if  (tv>0)ft(tv<tk) ; 
if  (tk-tv)  <  period (varseq) , 


X  full  periods  of  keyaeq 
X  time  for  full  periods 
X  part  periods  of  keyseq 
X  teat  for  continuous 
X  event  time 
X  event  in  BTP  range 
X  full  varseq  periods 
X  tine  for  full  periods 
X  part  varseq  periods 
X  test  for  continuous 
X  event  tirao  v/o  offset 
X  event  in  BTP  ft  tau>0 
X  if  offset  <  period 


X  check  for  discrete,  non-commuting  transitions 
apindx (keyseq) ■ j i ;  apindx(vareeq)«j2; 
spituix (keyseq)*spindx(keyseq)+l ; 
spindx (varseq) «spindx( varseq) ♦ i ; 
apindx-spindx" (spindx>seqlen) •aoqlan ; 
koytype*-seqptr(keyseq,»pindx(keyseq)){ 
vartype*-seqptr(varaaq,spindx(varseq) ) ; 

if  keytype>0,  X  synch  event  discrete 

if  vartype>Q,  %  asynch  event  discrete 

tempi-0S(: ,<i*(keytype-i)*nx): (k»ytype*a*))e. .. 

0S( : , (i+(vartype-i)*nx) : (vartypevnx) ) ; 
te»p2-0S(; ,(i*(vartyp#-l)*»x):(vartype*u*))e, . . 

DS(; , ( i* (key type- 1 )*ax) : (keytypsvnx)) ; 
if  any(any(tenpi-teKp2)), 

ctines*Cctinea,(tk-tv)3;  end;  X  son  commuting 
end;  end; 

X  check  complete*  ctiass  set  if  discrete  ft  non-commuting 

end;  end;  end;  end;  end;  end;  end;  end;  end;  X  end  ell  if* a  t  for** 

X  patch  here  to  fore#  an  additional  reglott(s) 

X  cti»es»£cti»*s  .35  .4<I5  .So); 

X  end  of  special  patch 
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ctimes»sort (ctimes ) ;  '/,  sort  sequentially 

ctimes=ctimes.*(ctiines>0) ;  X  remove  negative  times 

cases*length(ctimes) -1 ; 

uniq* [i , ( (ctimes (2 : cases+1) -ctimes (1 : cases) ) >tol)] ; 
ctimes^ctimes(uniq) ;  X  eliminate  duplicates 

fprintf ('\n’) 

X  end  of  function  cases  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ 


E.l. 6  Display  Time  and  Date:  shotime.m 


function  shotime (clock) 

X  Display  time  and  date  on  screen  in  standard  format 

fprintf (’\n’) ; 

fprintf ( int2str (clock (4) ) ) ; 

fprintf ( * : * ) ; 

fprintf (int2str (clock (5))) ; 
fprintf (*:*); 

fprintf (num2str(clock(6) ) ) ; 
fprintf (»  »); 

fprintf (int2str(clock (2) ) ) ; 
fprintf (’/’) ; 

fprintf (int2str (clock (3) ) ) ; 
fprintf (’/’) ; 

fprintf (int2str(clock(l))); 
fprintf (*\n’) ; 

X  end  of  utility  function  shotime  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ 
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E.2  Analysis  Routines 

E.2.1  Top-level  Structure 

+ - + 

I  ANALYZE  | 
+ - + 


+ - + 

I  BUILDTLA  I 
I  BUILDDIN  I 
+ - — — + 


- -4 - 

I 

♦ — - 4 

I  CHECK  I 

4 - -4 


- — 4 — - - 

I 

4 - - - 4 

|  UPDATE  | 

4 — - 4 


I 

+ — - + 

I  HRAS  | 

4— —4 


4 - «»4  ♦- - + 

i  CASES  |  I  PSIX  I 


4— ——4  ♦ - ♦ 


E.2.2  User  Interface;  analyze.m 

X  DRIVER  SCRIPT  FOR  KULTIRATE  ASYNCHRONOUS  STABILITY  ANALYSIS 

shotime (clock) ;  X  time  back  to  estimate  compute  time 

X*********************************************************************** 

X  This  block  creates  the  plant  and  cost  function 

X  description  matrices.  Replace  this  block  with  code, 

X  input  statements,  and/or  function  calls  that  Hill  create 
X  AB.  DS.seqptr, theta, varptr,  V*,xO,  BTP, and  keyseq  for 

X  the  system  you  want  to  analyte. 

X  LOAD  PLANT  ft  INITIAL  CONTROLLER  MODELS. 
aselainput(' Select  system:  1  «>  tla,  2  ■>  dint:  *); 
if  sselaal, 

[ AB , DS , seqpt r , theta » varptr ,  W ,  xO , BTP , keyseq] -buildtla ; 
else, 

if  sselaa2; 

CAB , DS , seqptr , theta, varptr , W , xO , BTP , keyseq] * build din; 
else, 

fprintf('\n  Unknown  system  type... abort  run.  \n*>; 
end; 
end; 


X  SELECT  INITIAL  GAINS  (theta) 
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tsel»input(’ Select  initial  theta;  l»>last  run,  2*>loaded  values:  *); 
if  tsel“i,  X  load  last  saved  theta  vector 

if  ssel**l,  load  tlatheta.mat,  else, 
if  ssel**2,  load  dintheta.mat,  end;  end; 
end; 

%*********************************************************************** 

X  VERIFY  DIMENSIONS  AND  COMPUTE  [consts] 
const8»check { A3 , DS , seqptr , theta , varptr , V , xO , BTP , keyseq) ; 
consts (IS) >.5;  X  assume  stable  with  initial  gains 

X  INSTALL  THETA  VALUES  IN  AB  AND  DS  MATRICIES 
[AB,  DS]  *  update(AB,DS, theta, varptr, consts); 

X  DISPLAY  INITIAL  GAINS 
f printf ( * \nTheta  »  X2.3g* ,theta(l)); 
for  jp»2: consts (5)  fprintf(*  X0.3f 1 ,theta(jp)) ;  end; 
f printf (’\n\n*) ; 

X  ********  CALL  MULTI-RATE  ASYNCH  STABILITY  EVAL  ROUTINE  ******** 

shotioe (clock) ;  X  time  hack  to  estimate  compute  time 

f printf (’Compiling  asynchronous  stability  test  code:  ..*)• 

stability«mraa(AB,DS, seqptr, consts) ; 

fprintfC  The  average  stability  figure  is:  Xg’ .stability) ; 


X  The  resulting  stability  figure  is  analogous  to  the  real  part 

X  of  a  continuous-time  pole.  "stability"<0  implies  the  system 

X  is  stable  with  the  error  state  decay  rates  bounded  above 

X  (on  average)  by  exp(stability*t). 

X  **************  END  OF  EVALUATION  CALCULATIONS  *************** 


ahotime (clock);  X  time  hack  to  estimate  compute  time 

X  end  of  main  program  $$$$$$$$$$$$$$$$$$$$$$$$$$$1$$$$$$$$$$$$$$$$$$$$$$ 


E.2.3  Main  Program:  mras.m 

function  atability«aras_e val ( AB , D3 , seqptr , consts) ; 

X  Evaluates  multi-rate  asynchronous  stability,  'stability*  is 

X  analogous  to  an  upper  bound  on  the  real  part  of  the  poles  of 

X  a  linear,  time- invariant  continuous-time  system. 
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y,  **************************************** 
X  **  This  version  is  limited  to  nseq«2  ** 
'/,  **************************************** 
fprintf (’  Compile  complete. \n' ) ; 


X  **********************  SET  CONSTANTS  ************************* 

X  number  of  states 


nx*consts(l) ; 
nxcaconsts (2) ; 
nxsaconsts(3) ; 
nseq*consts(7) ; 
seqlenaconsts (8) ; 
keyseqaconsts (9) ; 

BTP»consts(10) ; 
fastseq-consts(ll) ; 
trainlen*consts(12) ; 
speriod>consts(13) ; 
varseqa3-keyseq; 

ABvide»nxc+nxs; 

cyclesaround(trainlen/speriod) ; 


X  number  of  continuous  states 
X  number  of  sample  ft  hold  states 
X  number  of  sequences 
X  maximum  sequence  length 
X  Index  to  sequence  synchronous  with  BTP 
X  basic  time  period 
X  fast  sequence  number 
X  length  of  shorter  train 
X  period  of  shortest  sequence 
X  Index  to  sequence  with  variable  phase 


tola0.01;  X  tolerence  for  integral  convergence 

maxstepa.l*speriod;  X  maximum  integration  step  size 

minatepa.01*speriod;  X  minimum  integration  step  size 

X  **********************  SET  ARRAY  INDICES  ********************** 

colsal:nx;  offcol*acols-nx; 

phirows* 1 : nxc ;  phicols" i : ABwide ; 

DSrows»nxc*l:nx; 


X  **********************  COMPUTE  TRAIN  STM's  ***************** 
colsela-seqptr(faats*q,i)*nx*offcols;  X  DS  cols  for  end  events 
PsiaDS(: .colsel);  X  initial  Psi 

for  ja2:seqlen; 

lspa-s*qptr(fastseq,j);  X  event  identifier 

if  isp>0,  X  discrete  transition 

Psi (DSroue , : ) "DS (DSrovs , of f cola+isp*nx) *Psi; 
else,  X  isp  must  be  <  0  X  continuous  time  transition 

phiaexpa(-AB*iap) ;  X  continuous  STM  (isp*~t) 

Psi (phi rows, :)aphi (phi rows, : )*Psi(phicols, :) 5 
end;  X  if  isp>0  . . .  else  . . . 

end;  X  for  ja2:seqlen  X  no  more  discretes  in  speriod 

trains-Psi'cycles;  X  Extend  to  'cycles'  periods 

trains* [trains  Psi*trains];  X  Extend  to  ’eycles*l'  periods 

trains (DSrovs , :)«DS (DSrovs, colsel) strains;  X  Final  discrete  event 


X  **********************  INTEGRATIONS  a*************************** 


-  ---miifliimiMU  niisti 


twsuftususueviuivm/BiimftiuirwiNiftfirtJiviMwlftJiiUJWUlttnAlft/lWiWWfiVttJVUlf 
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brktimes*cases ( 1 , DS , seqptr , coasts) ; 


nzones»length(brktimes) -1 ; 
phasing=zeros (nseq, 1) ; 
varseq»3-keyseq ; 
ets«seqptr(varseq, :) ; 
vperiod*sum(ets . * (ets>0) )  ; 
slip*rem(BTP,vperiod) ; 
plott«[];  plotSR* []  ;  plotSIG*  []  ; 
I_lnSR*0;  I_lnSIG»0;  stab»0; 


index  to  slipping  sequence 
pointer  row  for  slipping  sequence 
period  of  slipping  sequence 
phase  decrease  in  next  BTP 
clear  plot  data  arrays 
initialize  log  integrals  to  zero 


Xfprintf (’Slip-XfXn*  .slip) ; 

X  phasing(varseq) »NextTau+vperiod* ( (NextTau<0) - (NextTau>vperiod) ) ; 


for  zone»l:nzones; 
tau«C3;  LSR»[];  LSIG»G; 
ts*brktimes(zone) ; 
te*brktimes(zone+l) ; 
tau(l)«(te+ts)/2; 
f ullspan«te-ts ; 
span*fullspan; 
oldpoints*0; 
newpoints*!,; 
zstab*0; 
good*0; 


X  step  through  zones 
X  null  out  data  vectors 


tau  range  of  interval 
Euler  integration  step  size 
no.  previous  data 
start  with  1  Euler  point 
initialize  zone  stability  figure 
assume  integral  not  converged 


fprintf (*\nZone  Start  Tau*Xf,  Zone  End  Tau-  Xf\n* ,ts,te) ; 


while  good«0,  X  repeat  until  integral  converges 

Xfprintf (’oldpoints"X.Of ,  newpoints"  X.Of ’ ,oldpoints,newpoints) ; 

Xfprintf (*,  tau  range*  Xgi  integ  step*ZgAn*  ,fullspan,span) ; 
newindx*(oldpoints+l) : newpoints {  X  indices  to  new  points 
for  i*newindx,  X  compute  data  at  newpoints 

phasing(varseq)*tau(i) ;  X  phase  for  current  BTP 

[ThisPl,ThiBSR]*psix(phasing,AB,DS, seqptr, conets, trains, . . . 

cols , of  f cols , phi rows , phicols , DSrows , 1 ) ; 

LSR(i)"log(ThisSR) ; 

HextTau*tau(  1) -slip;  X  phase  of  next  BTP 

phasing(varseq) "NextTau* vperiod* ( (HextTau<0) - (HextTau> vperiod) ) ; 
[NextLPI] *psix (phasing , AB , DS , seqptr , cons ts , trains , cols .... 

of f cols , phirows , phicols , DSrows , 2) ; 
LSIG(i)»log(nora(HextLPI*ThisPL) ) ; 

Xfprintf < ’ step*X • Of ,  phasing-Xg,  LSR*Xg',i,tau(i),lSa(i)); 

Xfprintf (* ,  ISIG-XgAnMSIG(i)); 
end;  X  for  i-newindx 

X  add  new  data  to  plot  vectors 


plott"[plott;tau(newlndx>!) ; 
plotSR* [plotSR; LSR(newindx) *]  ; 
plotSIG* [plotSXG ; LSIG (newindx) * ] ; 
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X  save  mrasdat  plott  plotSE  plotSIG  X  comment  out  for  clean  output 
shg 

plot (plott .plotSR, *x’ .plott, plotSIG, ’o’) ; 

X  compute/compare  integrals 
ILSR=span*sum(LSR) ; 

ILSIG*span*sum(LSIG) ; 
oldzs t ab*zst ab ; 
zstab*ILSR+ILSIG ; 

error*abs (  (zstab-oldzstab)/zstab  ); 

*/,f printf ( *  Integral  ln(SR)*Xg,  Integral  ln(SIG)*y,g\n,  .ILSR.ILSIG) ; 
Xfprintf (’  Zone  Stab (N/O/C) =X • 4g/y, . 4g/X .  4g .  \n* ,zstab,oldzs tab, error) ; 
if  span<minstep,  good*-!;  end; 
if  (error<tol)t(span<maxstep) , 
good-1 ; 

else,  X  if  (abs(. . .  )) 

span»span/3; 
oldpointa-newpoints ; 
newpoints*3*oldpoints ; 
tau* [tau; tau-span; tau+span] ; 
end;  X  if  (abs(...  ))  else 

end;  X  while  good-«0 

I.lnSR-I.lnSR+ILSR; 

I.lnSIG-I.lnSIG+ILSIG; 
atab-stab+zstab ; 
f printf (’Zones  1-X,0f:  I.ln(SR)-  %.3g',zone,I.lnSR); 
fprintf(’,  I.ln(SIG)  ■  X.3g,  Stab*  X.3g.  \n* ,I.lnSIG,stab); 
end;  X  for  zone*l:nzonea 
save  mrasdat  plott  plotSR  plotSIG 
stability* (stab/ (brktimea (nzones+1) -brktimes ( 1) ) ) /BTP ; 
return; 

X  end  of  function  mras  MtUUUtttMMmUMtUMmMmUUM 


X  convergence  failure 


X  cut  integration  step  size  by  3 
X  remember  old  number  of  points 
X  set  new  number  of  points 
X  new  phase  time  vector 


E.2.4  STM  Calculation:  psix.m 

function  [Pout, SR]*. . . 

pair (t2go ,AB,DS, sptr , con , trains .cols, of f cols , phirows , phicols , DSvows , sf lag) ; 
X  state  transition  matrix/f actors  for  mras.m 


t0*t2go; 
nx*con(l); 
nvar*con(5) ; 
seqlon*con(8) ; 
trainlen*con(l2) ; 


nxc*con(2) ; 
nvarc*con(6) ; 
DTP*con(10); 
speriod*con(13) ; 


nxs*con(3) ; 
nsoq*con(7) ; 
fastseq*con(ll) ; 
ABuide-nxc+nx* ; 
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PART  1:  COMPUTE  STM  FOR  BASIC  TIME  PERIOD 


X - Set  Pointers  for  Initial  Discrete  Events — - - 

X  t2go(i)  will  be  the  time  from  BTP  start  to  the  first  discrete 
X  event  for  each  sequence.  *sptr(i,spindx(i)) *  defines  the  event. 
done*i;  spindx=ones(t2go)*seqlen;  laststep*zeros(t2go) ; 
while  done>0;  X  completion  flag 

for  i*l:nseq,laststep(i)»sptr(i,spindx(i));end;  X  index  to  last  event 


laststep*laststep . * (las tstep>0) ; 
backstop* (laststep<t2go) ; 
done=8um(backstep) ; 
t2go*t2go-backstep . *laststep ; 
t2go*t2go . * (t2go>0) ; 
spindx»spindx-backstep ; 
spindx»spindx+seqlen*(spindx<i) ; 
end;  X  while  done>0 
spindx*spindx+l ; 

spindx»spindx- (spindx>saqlen) *soqlen; 


X  mask  discrete  events 
X  boolean 
X  0  if  done 
X  ad j is t  t2go 

X  eliminate  any  negative  times 
X  adjust  index 
X  fix  possible  wrap-around 

X  set  to  current  event 
X  fix  wrap-around 


X - - Compute  Psi,  the  STM  for  specified  t2go. - 

X  INITIALIZE 

zerotol«eps*BTP; 

done*l;  elaptime*0;  X  time  into  BTP 

[ti,ilj»min(t2go) ;  X  time  to  first  event 

isp«-sptr(il,spindx(ll));  X  identify  first  stm 

Pai«eye(ns);  X  initialize  Psi 

X  QUICKIE  INITIAL  DISCRETE  EVENT  IF  PRACTICAL 

if  isp>0,  X  first  event  discrete 

blksel*isp*nx*of f cols ; 

Psi*DS(: .blksel) ; 
apindx(il)uspinds;(il}*l; 
end;  X  if  isp>0 

X  MAIN  STATE  TRANSITION  MATRIX  (stm)  CALCULATION  LOOP 

while  done>0,  X  main  Psi  loop 

if  (elapti8uM'cl+2erot®l)>*BTP»tl»BTP-elaptitte;done«0;  end;  X  last  step 
8pin/.x»spindx-(8plndx>seqlen)+seqlen;  X  fix  any  wrap-around 

if  tl<*0,  X  tl*0  »>do  next  event  now 

st"sort(t2go) ;  X  find  next  event  time  too 

t2*st(2);  X  time  to  second  event 

if  (il**fast8eq)ft(t2»trainlen)t(spindx(il)MMl)t.. . 

((trainlen+elaptirae)<BTP) ,  X  next  event  is  a  train 

X  TRAIN  EVENT 

colsel*cols;  dt«trainlen;  X  use  short  train  indices 

if  (t2i>«(dt'*8period))i((dt*elaptiaa+8period)<&TP)»  X  k  cycles 


130 


Appendix  E.  Computer  Codes 


colsel=colsel+nx ;  dt=dt+speriod;  X  use  long  train  indices 
end; 

stm=trains ( : .colsel) ; 

Psi*stm*Psi; 
t2go»t2go-dt ; 
elaptime=elaptime+dt ; 
t2go(il)*tl; 

else,  X  next  event  NOT  A  TRAIN  EVENT 

isp»-sptr(ii ,spindx(il)) ;  X  event  identifier 

if  isp>0,  %  isp  points  to  DS  block 

X  DISCRETE  EVENT 
blksel»isp*nx+of f cola ; 
stm»DS (DSrows ,blksel) ; 

Psi (DSrows, :)»stm*Psi; 

else,  X  isp  must  be  <  0  %  i.e.  continuous  segment 

t2go(il)«t2go(il)-isp;  X  increase  that  t2go  element 

end;  Xif  isp>0  . . .  else  . . . 
end;  X  if  (ii»*fa8tseq  •••  else  .. 

spindx(il)*spindx(il)+l;  X  increment  sequence  index 

else,  X  if  (tl<»  0)  i.e.  tl>0  »>  time  passes,  continuous  segment 

X  CONTINUOUS  TRANSITION 

phi»expm(AB*tl) ; 

Psi(phirows, ;)»phi(phirows, :)*Psi(phicols, :) ; 
elaptlme«elaptime+tl ; 
t2go*t2go-tl ; 

end;  X  if  tl  <*0  ...  else  ... 

[tl.il] »min(t2go) ;  X  next  event  It  its  sequence 

end;  X  while  elaptime+tKBTP  X  no  more  discretes  in  BTP 

X***********+*********End  of  Psi  Calculation*********1***'***** 

X  PART  2:  COMPUTE  BALANCED  FACTORS  FOR  STABILITY  TEST 

X  sflag««l  — >  factors  for  "current"  BPT  (lambda  *  delta) 

X  sflag—2  —  >  factors  for  "next"  BTP  (delta  only) 

CP  L]-eig(Psi) ; 

PI»inv(P) ; 

L»diag(L) ; 

SR»norm(L,inf) ; 

L-sqrt(L/SR) ; 

for  i»l:nx 

p-P( : , i) ;  np»norm(p) ; 

pinv-PI ( i , : ) ;  npi»nont(pinv) ; 

bal«sqrt(npi/np) ; 

if  sflag«>»2,  Pout(i,:)«pinv*L(i)/bal; 
else,  Pout(:,i)-p*L(i)*bal;  end; 
end;  X  for  i«l:nx 
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y 


return; 

X  end  of  function  psix  $$$$$$$*$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$*$$$$$$$$$ 
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E.3  Design  Routines 

E.3.1  Top-level  Structure 

+ - + 

I  DESIGN  | 
♦ — + 


4 - - 4 — - + - 

I  I  I 

+ - —4  4 - 4  4 — - 4 

I  BUILDTLA  !  |  CHECK  I  I  UPDATE  | 

I  BUILDDIN  I  + - +  + - ♦ 

4 - - — — + 


4 — — - - 4 - - 4 

I  I  I 

4 - 4  4-- - ——4  4— — — — 4 

I  CASES  I  I  ACSTGRD2  I  I  UPDATE  | 

4 - 4  4 - - — -—4  4 - — - 4 

I 

4 - - - 4 - 4 

I  I  I 

4— ———4  4— ———4  4— ———4 

|  TRAINS2  |  |  PSI2PLUS  I  I  CSTGRD2  I 

4— ——4  4— ———4  4 - - - 4 


4— - 4 

I  VAR.0PT2  | 

4—" - -—4 

I 

I 

- - 4 


4 - - - 4 

I  LINSRCH2  | 
4— ———4 


4 - — 4 

I  I 

4— ——4  4- - —4 

I  ACST2  I  |  UPDATE  | 

4- - 4  4--— - 4 

I 

■——4 


4— — ■ 

!  I 

4— .—4  4— ——4 

)  PSI2  |  I  CSTGRD2  I 

4— -—-4  4— *——-4 


E.3.2  User  Interface:  design.m 

X  Driver  script  for  constrained  asynchronous  design  algorithm 

shotiae (clock);  X  tiae  hack  to  estimate  speed 

X  LOAD  PLANT  k  INITIAL  CONTROLLER  MODELS. 
ssel»input(* Select  system:  1  ■>  tla,  2  *>  dint:  '); 
if  ssel*«l, 

[ AB , DS , oeqptr , theta, varptr , U , xO , BTP , keyseq] -buildtla ; 
else, 

if  ssela*2; 

[  AB ,  DS , s  eqptr , theta , varptr, tf , xO , BTP , keyaeq] -builddin ; 


^  l  Skr  1 MAfLMUWtAUiy  U*  \Al\ JV  tftif  tJtt1 ajnsaA  tut 
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else, 

fprintf('\n  Unknown  system  type... abort  run.  \n’); 
end; 
end; 

X  VERIFY  DIMENSIONS  AND  COMPUTE  [consts] 
consts*check ( AB , DS , soqptr , theta , varptr , W , xO , BTP , keyseq) ; 
consts ( 15) *. 5;  %  assume  system  is  stable  with  initial  gains 

X  SELECT  t  INSTALL  INITIAL  GAINS  (theta) 
tsel»input(* Select  initial  theta;  0»>random,  i«>last  run,  2**>loaded:  '); 
if  tsel»*0, 

consts (15) =2;  X  assume  unstable  if  rand  gains 

theta»rand (theta) - . 5 ;  X  random  gains:  U(-0.5,  0.5) 

end; 

if  tsel=»l,  X  load  saved  theta  vector  (assume  stable) 

if  ssel»i,  load  tlatheta.mat,  else, 
if  ssel»2,  load  dintheta.mat,  end; end; 
end; 

[AB,  DS]  ■  update (AS, DS, theta, varptr, consts); 

X  DISPLAY  INITIAL  GAINS 
f printf ( ’ \nTheta  ■  X2.3g* ,theta(i)) ; 
for  jp«2: consts (5)  fprintfO  X0.3f ' ,theta(jp)) ;  end; 
f printf 0\n'); 


X  ***********  CALL  DESIGN  PROGRAM,  OPTIMIZE  [theta]  ************ 

X  Select  synchronous/asynchronous  phasing 
conata(14)»input( 'Select  method;  0»>Asynch,  l»>Synch:  '); 
consts ( 16) . 

inputOSelect  initial  cost  function;  0*>Stable,  l*>Unstable:  '); 
shotime (clock) ;  X  time  hack  to  estimate  speed 

f printf ('Compiling  parameter  optimisation  code:');  X  user  advisory 
[theta , AB , DS] ■  var_opt2 ( AB ,  DS ,  tf ,  xO , theta , varptr , seqptr , consts , ssel) ; 

shotime (clock) ;  X  time  hack  to  estimate  speed 

X  end  of  main  program  listing  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ 


E.3.3  Main  Optimization  Program:  var_opt2.m 

function  [theta , AB , DS] * . . . 

var .opt ( AB , DS , vO , xO , theta , varptr ,  seqptr , consts , ssel) ; 
X  main  driver  for  coefficient  optimisation 
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fprintfO  Optimization  compile  complete. \n’) 
fprintf (’\nBegin  parameter  optimization  (var.opt) .  \n’) 

X  for  single-sequence  or  synchronous  cases:  times* [0] 

*/•  for  the  two-sequence  asynchronous  cases:  [times]  partitions  the 
X  time  offset  (phase)  into  regions  of  continuous  ’Psi’ . 


nx*consts(l) ; 
nvar*consts(5) ; 
seqlen^consts^) ; 
fastseq=conflts(ll) ; 
oldalpha*le-6; 
grad=onea ( 1 , nvar) ; 
srchdir*ones(nvar,i) ; 
alpha*0 ; 

completed ; 

loopcount*l; 

totalcount*l ; 

maxcount*50; 

tol*.0001; 

mincost«tol; 

nomstep*.001; 


X  number  of  states 
X  number  of  variable  parameters 
X  length  of  longest  sequence 
X  index  to  shortest  sequence 
X  some  guess  to  initialize  step  size 
X  allocate  space 
X  allocate  space 
X  allocate  space 

X  completion  flag,  +1  if  ok,  -1  if  timeout 
X  counter  to  initialize  Hessian 
X  total  iteration  counter 
X  max  iteration  limit  (timeout  trigger) 

X  gradient  convergence  criteria 
X  cost  convergence  criteria 
X  nominal  alpha  guess  for  first  search 


X  PARTITION  OF  CONTINUOUS  PHASE  REGIONS 
[times]  •  cases (0,DS,seqptr,conats); 

X  FIND  CONTINUOUS  AND  DISCRETE  VARIABLES  IN  FASTSEQ 
cvarsel*(varptr(: ,1)**0);  X  boolean  of  cont.  vara. 

tvareel«cvarsel;  X  boolean  of  all  vars 

for  i*l:seqlen,  X  discrete  vars,  in  fastaeq 

tvarsel»tvarsel I (varptr( : , i)**-seqptr (f aatseq, i )) ; 
end; 

block»cumaua(tvarsel) .etvarsel-1;  X  block  offset  for  partial* 

block*nx*block;  X  column  offset  for  partial* 

tvarseW ind(tvarsel) ' ;  X  all  vars.  in  fastaeq 

cvara*l*fittd(cvars*l)';  X  continuous  vars  (in  AB) 

X  ********  MAIN  SEARCH  LOOP  •**•♦*♦* 
while  complete**0, 

fprintf('\nStart  gradient  search  number  *); 
fprintf(int2str(totalcount));  fprintf ('\n') ; 
lastgrad-grad; 

[cost, grad, stable]*. . . 

acstgrd2 (times , vO , xO , AB , DS , seqptr , varptr , const* , block , tvarael ,c varsel) ; 
delgrad*grad-lastgrad; 
gradnorm*nora(grad) ; 
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X  COMPUTE  SEARCH  DIRECTION 

X  quasi-Newton  search  using  Broyden-Fletcher-Goldfarb-Shanno  update. 

X  update  Hessian,  "G" 

if  loopcount=»l,  X  reset  Hessian  to  I 

G=eye(nvar);  nsd«l;  oldalpha*nomstep; 
else,  X  if  loopcount»»i  X  compute  Hessian  update 

G*G+lastgrad**la8tgrad/(lastgrad*srchdir)+. . . 
delgrad*  edeigrad/ (alpha*delgrad*srchdir) ; 
end;  X  if  loopcount«»i, 

if  min(real(eig(G)))<*epa,  G«eye(nvar);  end;  X  insure  G  positive  def. 

X  compute  search  direction  A  step  estimate 
cldalpha*oldalpha*nsd ; 

archdir*-G\grad' ;  X  Newtonian  search  direction 

nsd«norm(srchdir) ; 

oldalpha*oldalpha/nsd;  X  initial  step  size  estimate 

fprintf  (’Cost"X6.5g.  I  iGradl  l«X6.5g.  |  iSrchDirl  l»X$.5g\n*  ,cost,gradnozm,nsd) 

X  COMPUTE  STEP  (ALPHA)  TO  MIN  COST 

alpha«linarch2(srchdir,Gldalpha, cost, times, «0,x0,AB,DS, theta, . . . 

aaqptr , varptr .conata) ; 
if  alpha<"epa,  alpha«0;  loopcount«0;  end; 
oldalpha»alpha*le-6;  X  ensure  old  step  is  positive 

X  UPDATE  PARAMETER  SET 

theta»theta*slph**«rchdir;  X  update  theta 

CAB , DS] -update (AB , DS , theta, varptr , conata) ;  X  update  AB  and  DS 

if  ((atable-l)*(conats(i5)Ml))<0,  loopcount«l;  end; 
consts ( IS) ■stable ; 

fprintf CVnTheta  ■  X2.3g* ,theta(l)); 

for  jp»2:nvar  fprintf ('  X2.3g* .theta(jp));  end; 

fprintf(*\n'); 

X  SAVE  GAINS  FOR  FUTURE  REFERENCE 

if  ssel««l, 

save  tlatheta.mat  theta; 

else, 

if  ssel««2,  save  dintheta.mat  theta;  end; 
end; 


X  TEST  FOR  CO;£L£TION/TXKEQUT 
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if  tota!count>maxcount,  complete*- 1;  end; 
if  gradnora<tol*cost,  complete*!;  end; 
if  cost<mincost .  complete*!;  end; 

%  if  loopcount<3*nvar,  loopcount*0;  end;  %  arbitrary  Hessian  reset 
loopcount*loopcount+l ; 
totalcount*totalcount+l ; 

end;  X  while  complete'*  (main  search  loop) 

return; 

%  end  of  function  min.var  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ 


E,3.4  Asynchronous  Cost  and  Gradient:  acstgrd2.m 

function  [cost, grad, stable] *.. . 

ac3tgrd2 (brkt imes , vO , xG , AB , DS , seqptr , varptr , consts , block , tvarsel , cvarsel ) ; 
%  estimate  average  cost  k  gradient  over  phase  using  polynomial  curve  fit 
xsafe*.99;  1  end  point  setback  insures  unique  transition 

%  **M*M*M**«M»»«MM*«*M*««*M*MM*M**»****M 

%  **  This  version  is  limited  to  ns*q*i  or  2  only.  •• 

%  eteeeeeeeeeeeeeee********************************* 

Xeeeeeeeteeeeeeeeeeeeeeeeeeee******************************************* 

l 

X  OUTPUT^;  cost  *  phasing- weigh ted  asynchronous  cost  function  (scalsr) 

%  .  grad  *  gradisnt  of  cost  WRT  theta  (column  vector) 

X  \  stable  *  flag  to  salect  correct  cost  function  in  linarch.m 

X  INPUTS;  \  brkt imes  *  sorted  vector  of  teu’s  that  partition  regions  of 
%  continuous  Psi(tau) . 

X  wO ,  xO ,  AB ,  DS , seqptr , vaxptr, conets .  (ess  build  t  check) 

% 

£••***•*««#***•»•»** •*«**eeee**eeee**ee*ee*e**e**«*ee*e*e*e***e*«*****t* 

XMeeeeeeeeeeeSe**  STATE  TRANSITION  XATHU  PARAMETERS******************* 

X 

X  These  parameters  are  defined  for  any  time  period: 

X  Psi  *  State  Transition  Matrix  for  ths  psriod 
X  FsiDot  *  partial  of  Psi  vrt  a  variable  parameter  (theta  element) 
t  V  •  weighting:  x(o)*U  x(0)*\iategral_(period>  x(t)'W0  t(t)  dt 
t  V_dot  *  partial  W  vrt  a  variable  parameter  (theta  element) 

X  X  *  E{x(f)x(f)’>  from  procese  noise  (xO)  during  period  (if  x(0)*0) 
t  X_dot  *  partial  of  X  vrt  a  variable  parameter  (theta  element) 

1  Y  *  E{\  integral  ..{period)  x(t)*WQ  x(t)  dt>  if  x(Q)*0.  (scalar) 

X  Y.dot  *  partial  Y  vrt  a  variable  parameter  (theta  element) 


-  meax w  wtli wt: ■aM.ufcg  MKikmLiamfhit f kat *M. ftM  w*»«e m' 
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*4  RECURSIVE  ALGORITHM  FOR  COMPUTING  STM  PARAMETERS 
X  Suppose:  Psi(tf.tO)  *  T(n)*T(n-i)*  ...  *T(2)*T(1),  where  T(i)  is 
X  the  state  transition  matrix  (stm)  for  the  i'th  segment  of  the  BTP. 

X  Let  Q(i),R(i),  S(i)  represent  W,X,  and  Y,  respectively,  for  T(i) . 
X 


X 

Initialize: 

X 

Psi(0)*I, 

PsiDot(0)»[0,0, . 

...0,0] 

These  may  be  considered 

X 

W(0)=0; 

W_dot(0)*[0,0, . . 

.,0,0] 

correct  values  for  Ti*I, 

X 

X(0)*0; 

X_dot(0)=[0,0, . . 

.,0,0] 

a  null  transition  with 

X 

X 

X 

Y(0)=0; 

Recursions: 

Y_dot(0)=[0,0, . . 

.,0,0] 

zero  elapsed  time. 

%  Psi(i)=T(i)*Psi(i-i) , 

y.  PsiDot(i)=T(i)*PsiDot(i-l)+T_dot_(i)*Psi(i-l) , 

%  W(i)=H(i-i)  +  Psi(i-l)’*Q(i)*Psi(i-l) 

y.  W_dot(i)=W„dot(i-i)  +  PsiDot(i-i) ’*Q(i)*Psi(i-i) . . . 

X  +Psi(i-l)’*Q..dot(i)*Psi(i-l)  +  Psi(i-i) ’*Qi*PsiDot(i-l) 

X  X(i)»T(i)*X(i-i)*T(i)»  +  R(i) 

y.  X_dot(i)=T_dot(i)*X(i-i)*T(i)’  +  T(i)*X_dot(i-l)*T(i)’... 

y.  +T(i)*X(i-i)*T_dot(i)  *  +  R_dot(i) 

y.  Y(i)-Y(i-1)  +  X(i-i)  .*Q(i) 

X  Y.dot (i ) *Y_dot (  i- 1 )  +  X_dot(i-l) >Q(i)  +  X(i-l) .*Q.dot(i) 

X 

*/,  Then,  Psi(n),  PsiDot(n),  W(n),  W„dot(n),  X(n),  X„dot(n), 

X  Y(n)  and  Y_dot(n)  apply  to  the  period  covered  by  Psi. 

X 

%*********************************************************************** 
y,  ****************************  TRAIN  DATA  ****************************** 

y. 

y,  Train  concept:  The  fastest  sampler  has  frequent  bursts  or  trains  of 
%  k  or  k-1  consecutive  short  sample  periods  where: 
y.  k'»tninc(2,nd  shortest  sample  period/shortest  sample  period), 

X  Data  for  these  fixed  STM's  are  precalculated  and  stored  in  't.rndat' 

X  to  avoid  subsequent  reduce  redundant  calculations,  'trndat' 

X  includes  the  discrete  events  on  both  ends  of  the  fast  'sample  train.’ 
X 

X  The  precalculated  trndat  and  cc  parameters  are  defined  as: 

X 


y. 

qq 

m 

C  Wi  ;  W2  ] 

X 

RR 

m 

C  XI  i  X2  ] 

X 

ss 

m 

C  Y1  ;  Y2  ] 

X 

V 

TT 

9 

C  Psii  ;  Psi2  ] 

h 

X 

QQdot 

m 

C  Wi.dot.l  . . . 

Wi„dotjavart  ; 

X 

W2_dot_i  . . . 

W2.dot„nvart  j 

X 

RRdot 

u 

C  Xi.dot.i  . . . 

Xi.dot.nvart  j 
X2.dot.avart  j 

X 

X2wdotfWi  « •  * 
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'/,  SSdot  *  C  Yl_dot_i  . . .  Yl.dot.nvart  ; 

'/,  Yl_dot_2  . . .  Y2_dot_nvart  ] 

'/,  TT  -  C  Psi!_dot_l  ...  Psil_dot_nvart  ; 

X  Psi2_dot_i  . . .  Psi2_dot_nvart  ] 

X 

'/,  Where  Psil,  Wl,  XI  and  Y1  apply  to  the  shorter  train  (k-i  periods), 

'/,  and  Psi2,  W2,  X2,  and  Y2  apply  to  the  longer  train  (k  periods). 

X  The  ’_dot_i’  notation  indicates  the  partial  with  respect  to  the  i’th 
'/,  variable  (theta  element)  in  the  fast  sequence  (nvart  such  variables) . 
X 

‘y£***************************************************>»**************** 

nx=consts (1) ;  nxc»consts (2) ;  nxs=consts (3) ; 

nvar*consts (5) ;  nseq«consts (7) ;  seqlen»consts (8) ; 

keyseq®consts(9) ;  varseq®3-keyseq;  fastseq«consts(ll) ; 

X  note:  synch  ■  consts(14),  synch*»l  forces  synchronous  phasing 
X  note:  stable  *  consts(15),  stable>i  selects  unstable  cost/grad 

if  (nseq<l) I (nseq>2) ,  errmsgC’nseq  out  of  range,  acsrgrd’);  return;  end; 

X  PRECOMPUTE  DATA  FOR  FAST  SAMPLE  TRAIH 
[QQ ,  RR ,  SS ,  TT , QQdot , RRdot , SSdot , TTdot] » . . . 

trains 2 (vO ,  xO ,  AB ,  DS , seqptr , varptr , cons ts , block , tvarsel , c varsel) ; 

stable®0; 

synch  ■  consts(i4); 
ncases*length(brktimes)”l ; 
if  synch*®!,  ncases»0;  end; 
phasingazeros (2,1); 

if  ncases>«Ot  X  this  is  a  synchronous  problem 

X  patch  here  to  hard-wire  synchronous  phase  (patch  acst2  likewise) 

X  phaaing(l)*eps; 

X  end  of  patch 

fprlntfC*  Synch  Cost  ft  Gradient  (one  case) An  *); 
CPsi,xxt,wwt,yyt,Laa,P,xxtdot*wwtdot,yytdot,La»Dot,PDot]*». . . 
p»i2plua (phasing, AB,DS, seqptr, varptr, consts, xQ, «0, QQ.RR.SS, TT,.. . 
block, tvar*el, QQdot, RRdot, SSdot, TTdot) ; 
stableamax Cabs (Lam) ) ; 

Ccost, grad] »cstgrd2(wut,xxt,yyt,Psi, consts, laa,P,wwtdot,xxtdot, . . . 

yy tdot , LarnDot , PDot ) ; 

return; 

else,  X  if  ncasesMoO 

if  nseq"*2,  errmsgC1 EXECUTION  ERROR,  ns«q"®2  in  acsrgrd*) ;  end; 
end; 


X  »1  for  synch  treatment 
X  select  synch/ asynch 
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f printf ( *  Asynch  Cost/ Grad :  X 2 . Of  * , ncases) ; 
fprintf ( ‘  continuous  phase  regions.  \n’) ; 

X  compute  percentages  for  each  interval 
t^eights3brktimes(2: (ncases+l))-brktimes(l incases) ; 
tweights*tweights/ (brktimes (ncases+1) -brktimes (1) ) ; 

cost*0;  grad«zeros(i,nvar) ; 

t*zerog(3,l) ;  y«zeros(3,l) ;  g»zeros(3,nvar) ; 
xa»l/xsafa;  xc«xa*xa*xa/3; 

X  COMPUTE  \INTEGRAL_{PHASING>  COST,  AND  GRADIENT  FOR  REGIONS 
for  i=l incases, 

ts*brktimes(i) ;  te»brktimes(i+i) ;  span*(te-ts)/2; 
t(2)»(ta*te)/2;  t(l)»t(2)-xsafe*span;  t(3)«t(2)+xsafe*span; 

for  j«l:3;  X  gat  costs/grads  for  3-point  fit 

phasing (varaeq)«t(j) ; 

[Pa i , xxt , wet , yyt , Lam, P , xxtdot , wwtdot , yy tdot , LamDot , PDot] ■ . . . 
psi2plus (phas ing , AB , DS , seqptr , varptr , consts , xO , wO , QQ , RR, SS , TT , . . . 
block , tvarsel , QQdot , RRdot , SSdot , TTdot ) ; 
stable-maxC [abs (Lam) ;  stable] ) ; 

Cy(j) ,g(j , :)]"cstgrd2(wwt, xxt, yyt, Psi, consts, Lam, P, wwtdot, xxtdot, . . . 

yy tdot , LamDot , PDot) ; 

end;  X  for  j»l:3 

X  approximate  curve  as:  y  ■  c  x*“2  ♦  b  x  ♦  a,  x  \in  (-1.01,1.01). 

X  where  a«y(2);  b«(y(3)-y(l))/2;  c»(y(3)-2*y(2)*y(l))/2. 

X  Then  \intagral  y(\tau)  d\tau  ■  c(2x“3)/3  ♦  a(2x)  with  x>l/xsafe. 

a»y(2) ; 
adot«g(2, :); 
c«(y(3)-2*y(2)*y(l))/2; 
cdot«(g(3, :)-2*g(2, :)+g(l,:})/2; 

X  include  current  phase  region  in  composite  cost/grad 
delcost»tweighta(i)*(c*xc*a*xa)i 
cost»cost+delcost ; 

grad“gradnwaights (i) ♦ (cdot*xc*adot*xa) ; 

fprintf ('  Region  *);  fprintf (int2str(i)); 
fprintf ( *  (tau"X6 . 6f*X6 . 5f ) . * , ts , te) 
fprintf ('  DelCost«X6.5f .  Cost»X6.5f An* .delcost.cost) 
end;  X  for  i»l incases 

return 

X  end  of  function  tcstgrd2  $$$$*$}$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ 
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E.3.5  Asynchronous  Cost  Only:  acst2.m 


function  cost«acst2 (brktimes , wO , xQ , AB , DS , aeqptr , consts) ; 

X  estimate  cost  averaged  ovar  phasa  using  polynomial  curve  fit 
X  saa  function  acstgrd2  for  detailed  comments 

%  For  validation  tasting  of  tmdat  k  cc,  declare  as: 

X  function  [QQ,RR>SS,TT]»trnst8t2(vO,xO,AB,DS,seqptr, consts) ; 

X  and  delete  indicated  portion  at  end. 

X  ************************************************** 

X  **  This  version  is  limited  to  nseq»i  or  2  only.  ** 

X  ************************************************** 


nx»consts(l) ;  nxc»consts(2);  nxs»consts(3) ; 

nseq»consts (7) ;  seqlen»consts (8) ;  keyseq«consts (9) ; 

f astseq*consts (1 i) ;  ABwide«nxc+nxs ; 

cycles»round(conata(12)/consta(13)) ;  %  trainlen/speriod 

if  (nseq<l) I (nseq>2) ,  errmsgC’nseq  out  of  range,  acsrgrd’);  return;  end; 

X  fixed  indices  tor  array  operations 

cols«l:nx;  cols2»cols*nx;  offcols«cols-nx; 

phirovs«-i :  nxc ;  phi2rove«phirows*nxc ; 

phicols" 1 : ABvide ;  phi2cols>phicols*ABuide ; 

X  COMPUTE  PARAMETERS  FOR  ONE  CYCLE  OF  FASTSEQ. 

X  Put  first  event  in  train  data 

ispa-seqptrCfastsoq.l);  X  initial  event  number 

blki»isp*nx>offcolsj 

rovs*ll*find(any(DS(: ,blkl) •-eye(nx))) ;  X  non'’ identity  rove 

Q*zeros(nx); 

R*zeros(nx) ; 

S-0; 

T-DS(:,blki); 


X  Include  rest  of  first  cycle  in  train  data 

tor  j«2:seqlen; 

isp— seqptr(faatseq,J) ;  X  event  identifier 

if  isp>0,  X  isp  points  to  DS  block 

X  DISCRETE  EVENT 


blk«isp*nx*offcols;  X  index  to  DS 

rows*l*find(any(DS(:,blk)'-eye(nx)));  X  non-identity  rows 

stm*DS<rovsel,blk);  X  new  stn 

RCrowsel , : )>stm*R;  X  X«stm*X 

Krowsel, :)«stm*T;  X  Psi-st»*Psi 
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R(: ,rowsel)*R*stm’ ;  X  X3[stm*X]*stm’+process  noise 

R(ro98el,rowsel)aR(rowsel,rowsel)+xO(rowsel,rowsel) ; 
else,  X  isp  must  be  <  0  X  continuous  time  only 

X  CONTINUOUS  TIME  TRANSITION 

tl»-isp;  ABti*AB*tl;  Atl«ABti(phirows,phirova) ; 
tempvq»[-ABti’ ,vO(phicols,phicols)*tl;zeros(ABwide) ,  ABtl] ; 
tempxr«OAti,x0(phiro9s>phirovs)*tl;zeros(nxc) ,  Atl'] ; 
tempwq=expm(tempwq) ; 
tempxr*expm(tempxr) ; 

phix»tempwq(phi2cols,phi2cols) ;  X  phi  extended 

phi»phix(phiroBS, :);  X  phi3[Phi(ti) ,Gamma(tl)] ; 

Qti»«0*tl;  X  Qtl»\integral_<0>“{tl>  B’expCA’t)  «0  exp(At)  B  dt 

Qtl(phicols,phicols)*phix’*tempwq(phicolB,phi2cols) ; 

X  Rtl»\integral_<0>“{ti>  exp(At)  xO  exp(A’t)  dt 
Rti*phi(: ,phirows)*tempxr(phirovs,phi2rovs) ; 

S3S+sum(sum(R.*Qtl)) ;  X  delta  cost  correct 

qtemp*T’*Qtl;  X  Psi’eQ 

RCphirows, :)3phi*R(phicola, : ) ;  X  X»Btm*X 

Q=*Q+qtemp*T;  X  W»W+Btm*  *Q*stm 

Kphirovs , : )*phi*T(phicols , : ) ;  X  Psi»atm*Psi 

R(: ,phirowa)«R(: ,phicola)*phi’ ;  X  X*[8tm*X]*stm’ 

R(phirows,phirova)»R(phirovs,phirows)+Rtl;  X  X«[stm*X*8tm’3+R 

end;  X  if  isp>0  ...  else  ... 

end;  X  for  j«2:seqlen  X  no  more  discretes  in  speriod 

X  EXTEND  TO  ’CYCLES'  t  ’CYCLES+1*  PERIODS  AND  ADD  FINAL  DISCRETE  EVENT 
Psi-T; 

X-R; 

W-Q; 

cc»S ; 

stm*DS(rowsell,blkl) ;  X  sta  for  final  event 

loopcount* [cycles, 2] ;  X  set  number  of  loop  iterations 

for  case»l:2;  X  1:  first  cycles  periods;  2:  last  period 

for  i»2:loopcount(case), 
ce»cc*aum(sum(X.*Q))*S; 
qtemp>Fsi’*Q; 

X-T*X; 

V»W*qtemp*Psi; 

Psi«T*Psi; 

X-X*T’*R; 

end; 

baae»(case-l)*nx;  colael-baae+cola;  rovsel-baee+rowsell; 

QQCcolsel, :)*U; 

SS(case)*cc; 

RRCcolsel, :)»X; 

RRCrovsel, :)«atm*X; 

TTCcolsel,  :)»Pai;  TTCrowel,  :)»stm*Psi; 
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RR(colsel,rowsell)*RR(colsel, :)*stm’ ; 

RR (rows  el , rows el 1 ) ®RR (rowsel , rowsel l)+xO (rowsel 1 , rowsell ) ; 
end;  X  lor  case*l:2 

X  ************************************************************** 

X  DELETE  EVERYTHING  FROM  HERE  DOWN  TO  CREATE  TRNTST.M 

y,  ************************************************************** 

synch  *  consts(14);  X  *1  lor  synch 

ncase8*length(brktimes) -1 ; 

11  synch5**!,  ncases*0;  end;  X  select  synchronous 

phasing=zeros (2,1); 

11  ncases**0,  X  this  is  a  synchronous  problem 

X  patch  here  to  hard-wire  synchronous  phase  (patch  acstgrd2  likewise) 
X  phasing(i)»eps; 

X  end  of  patch 

[Ps  i ,  xxt ,  wwt .  y  y  t]  * , . . 

ps 12 (phas ing , AB , DS , seqptr , const s , xO , wO , QQ , RR,SS , TT) ; 
cost*cstgrd2(wwt ,xxt ,yyt ,Psi ,consts) ; 
return; 

else,  X  if  ncases*«0 

if  nseq“*2,  erraag(* EXECUTION  ERROR,  nseq"*2  in  acsrgrd*);  end; 
end; 

y*zeros(3,l) ; 
varseq"3-keyseq; 

X  compute  percentages  for  each  interval 
tveights*brktimes(2: (ncasas*l))-brktimes(l incases) ; 
tweights«tweights/ (brktimes (ncases+l ) -brktimes ( 1) ) ; 
cost«0;  t*zeros(3,l);  y*zeros(3,l) ; 

xsafe».99;  X  back-off  from  ends  to  ensure  unambiguous  transition 

xa*l/xsaf*;  xc*xa*xa*xa/3; 

X  compute  \integral  ..{phasing}  cost,  and  gradient  for  regions 
for  i*l:ncases, 

ts«brktimes(i);  te»brkt lews (1*1) ;  span*(te-ts)/2; 
t(2)*(ts+te)/2;  t(l)*t(2)-xsafe*span;  t(3)*t(2)<-xaafe*span; 

for  j«l:3;  X  get  costs/grads  for  3-point  fit 

phasing(varseq)*t(j) ; 

CPsi,xxt,wwt,yyt]*. . . 

ps i2(phasing , AB , DS , seqptr , consts , xO , wO , QQ , RR,SS ,TT) ; 
y ( j ) *cs tgrd2 (wwt , xxt ,yyt , Psi , consts) ; 
end;  X  for  j-l:3 
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X  approximate  curve  as:  y  ■  c  x*2  ♦  b  x  ♦  a,  x  \in  (-i. 01,1. 01) . 

X  where  a»y(2) ;  b»(y(3)-y(l))/2;  n»(y(3)-2*y(2)+y(l))/2. 

X  Then  \integral  y(\tau)  d\tau  ■  c(2x~3)/3  ♦  a(2x)  with  x»l/xsafe. 

a=y(2) ; 

c»(y(3)-2*y(2)+y(l))/2; 

X  include  data  from  current  phase  region  in  composite  cost/grad 

cost»cost+tweights (i) * (c*xc+a*xa) ; 

end;  X  lor  i*l: 
return 

X  end  of  function  acst2  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ 


E.3.6  Cost  and  Gradient  Definition:  cstgrd2.m 

function  [cost , gradient] «... 

cstgrd2 (wwt , xxt , yy t , Psi . consts , Lam, P , wwtdot , xxtdot , y y tdot , LamDot , PDot ) ; 


X  This  function  computes  the  cost  or  cost  plus  gradient  for  the 
X  BTP  state  transition  matrix  Psi  (i.e.  at  one  phase  condition). 

X  For  cost  alone,  the  lest  four  input  arguments  are  optional. 

X  INPUTS:  wwt  ■  state  error  weighting  metric  (positive  semi  definite) 
X  xxt  »  expected  disturbance  covariance  (process  noise) 

X  yyt  «  cost  correction  for  noise  in  current  BTP 

X  wwtdot  «  partials  of  state  error  weighting  matrix 

X  xxtdot  «  partials  of  expected  disturbance  covariance 

X  yytdot  *  partials  of  cost  correction  wrt  theta 

X  theta  a  row  vector  of  the  undetermined  coefficients. 

X  consts  *  row  of  system  constants 

X  Lam  ■  column  vector  of  the  eigenvalues  of  Psi. 

X  P«  eigenvector  matrix  of  BTP  state  transition  matrix 

X  LamDot  «  the  nx  by  nvar  Jacobian  (d  Lam/d  theta). 

X  PDot  a  row  of  (d  P/d  theta(D)  blocks 

X  One  of  two  cost  functions  are  selected  by  consts(15). 

X 

X  If  consts(16)>l, 

X  costasum(abs(eig((Psi))).“8),  4*th  order  version  commented  out 

X 

X  If  consts(lS)<l, 

X  cost  •  xxt.*(P,\[i./(l-conj(Lim)*L4m.,)-l).*(P*ew»teP))e/P) 
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X 

X  This  is  the  weighted  (by  wwt)  value  of  the  expected 

X  noise  power  for  specified  process  noise  (xxt) . 

X 

nx=consts(l) ;  %  total  number  of  states 

nvar*consts(5) ;  X  number  of  variable  parameters 

stable-consts(lS) ; 

BTP»consts(10) ; 

if  nargin<7,  X  supply  any  missing  arguments 

[P,Lam]-eig(Psi); 

Lam*diag(Lam) ; 

for  i«l:nx,  P(: ,i)»P(: ,i)/norm(P(: ,i)) ;  end; 
end;  X  if  nargin<5, 

if  8table>»l;  X  use  unstable  cost  function 

omega-conj (Lam) .*Lam; 

temp-omega. ~3;  X  eighth  order  cost 

X  tenp-omega;  X  fourth  order  cost 

cost-omega  *  * temp ; 

if  nargout>l,  X  compute  gradient  too 

omega-temp; 

gradient-8*real ( (omega . *Lam) *  *LamDot) ; 
end;  * 

else,  X  if  stable>-l  , . .  else  ...  X  use  stable  cost  function 
ALam-aba(Laa); 

if  max(ALam)>l-epa,  X  if  actually  unstable 

cost-l/epa;  X  near  infinite  cost 

else,  X  if  max(ALam) . . .  else  ...  X  i.e.  if  stable 

omega-(l)  ./(i-cou^Ua)*!**.*); 
vp»vwt*P; 
pvp-P'ewp; 
temp-omega. ♦pup; 
invp-inv(P) ; 

tempi -real (invp  * *temp* invp) ; 
cost«sum(sum(xxt . -tempi) )-yy t ; 
cost-cost/BTP; 

if  nargout>l,  X  compute  gradient  too 

oaagaaq-omega . Iomega ; 
cols«l-nx:0; 

for  i-i :nvar,  X  for  sach  variable 

inx>i*cut; 

pvpdot-PDot(: ,inx*cols) ’*wp;  X  interrim  result 

ptfpdot-pvpdot+pwpdot’-»P’*wtdot( :  ,inx+cols)*P; 
om*gdot-conj(Lam)*LaaDot(: ,i) . * ;  X  interrim  result 

omegdot- (omegdot+omegdot 1 ) . •oaegaaq ; 
tempdot-oaega . epwpdot-osegdo t . *pwp ; 
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temp3«(tempdot-2*temp*invp*PDot(: ,inx+cols)) ;  X  interrim  result 
temp2»xxt . *real (invp  * *temp3*invp)+xxtdot ( : , inx+cols) . *templ ; 
gradient (i)»sum(sum(temp2))+yytdot(i) ; 
end;  X  for  i«l:nvar 
gradient»real (gradient) /BTP ; 
end;  X  if  nargout>l 

end;  X  if  max(AbsLam)>l-eps  ...  else  ... 
end;  X  if  stable 
cost*real(cost) ; 
return; 

X  end  of  function  cstgrd2  $$$$*$$$$$$*$1***$$$$****$$$$$*$$$$$$$$$$$$$$* 


E.3.7  STM  and  Partials:  psi2plus.m 

function  [Psi,XX,«V,YY.Lam,P,PXX,PWW,PYY,PLam,PP]«. . . 

psi2plus(t2go,AB,DS,sptr,vptr,con,xO,wO,qq,rr, ss, tt, block, tvar.pqq,  prr, pss.pt 

X  "psi2plufl"  computes  BTP  STM,  related  matrices,  and  gradients. 

X  See  extensive  comments  at  end  of  code. 

f printf ( ’  psi2plus :  *) ; 

X  UNPACK  CONSTANTS 

nx«con(l)j  nxc»con(2); 

nv*r*con(5) j  nvarc«con(6) ; 

seqlen«con(8) ;  BTP«con(10) ; 

trainlen*con(12) ;  speriod*con(13); 

X  CREATE  INDICES  FOR  ARRAY  OPERATIONS 

cols«i:nx;  offcols«cols-nx;  varindx»l invar; 

phirovs" 1 : nxc ;  x2colsephirowe+nxc ;  x3col««x2cols*nxc ; 

phicols«l:ABwide;  v2col«»phicol*+ ABvide ;  v3col«-e2cols*ABuide; 

offpcols*phicols-nx;  of£pro**“phirow*-cx; 

X  SET  INDICES  FOR  PARTI ALS  CALCULATIONS 

if  nargout>6,  nvart«length(tvar) ;  cvarsel*find((vptr(: ,i)«*0)’); 
else,  varindx* □ ; t  var* G ; nvart«0 ; cvarsel" □ ; nvarc«0 ;  vptr(l, :)•-!;  end; 

X  VERIFY  t2go  IN  RANGE 

if  length(t2go)'*nseq,  errmsgC' Extra/miss log  phase  times.’);  end; 
if  (any(t2go<0)),  errmsgC’ Negative  time  to  go  in  pel  plus.’);  end; 

X — — - — —Set  Pointers  for  Initial  Discrete  Events - - - 

X  t2go(i)  will  be  the  time  from  BTP  start  to  the  first  discrete 
X  event  for  each  sequence.  ’sptr(i.spindx(i)) ’  defines  the  event. 
done“l;  spindx«ones(t2go)*seqlen;  laststep-zeros(t2go) ; 
while  done>0;  X  completion  flag 

for  i*l:nseq,laststep(i)>sptr(i>spindx(i));end;  X  index  to  last  event 
laststep»laststep.*(laststepX));  X  mash  discrete  events 


nxs«con(3) ; 
nssq*con(7) ; 
fastseq-con(ll) ; 
ABwide»nxc+nxs; 
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backstop* (laststep<t2go) ; 
dona*sum(backstep) ; 
t2go»t2go-backstep . *1 aststep ; 
t2go»t2go . * (t2go>0) ; 
spindx*spindx-backstep ; 
spindx*spindx+seqlen*(spindx<i) ; 
end;  %  while  dona>0 
spindx»spindx+l ; 

spindx»spindx- (spindx>seqlen) *seqlen ; 


X  boolean 
%  0  if  done 
X  adjust  t2go 

X  eliminate  any  negative  times 
X  adjust  index 
X  fix  possible  wrap-around 

X  set  to  current  event 
X  fix  wrap-around 


X - Compute  Psi,  PsiDot,  XX,  PXX,  WW,  PWW,  YY,  PYY - 

X  Psi  ■  psi,  the  state  transition  matrix  for  the  specified  t2go. 

X  PsiDot  ■  [d  Psi/d  theta- 1,  ...  ,  d  Psi/d  theta-nvar]  {nxn  block  row} 
X  XX  =  E  xx*  at  BTP  end  from  process  noise  during  BTP 
X  PXX  *  partials  XX  wrt  theta  {row  of  nxn  blocks} 

X  WW  »  matrix  s.t.  xO’*WW*xO  is  the  cost  for  xO  error  at  BTP  start 
X  PWW  •  partials  WW  wrt  theta  {row  of  nxn  blocks} 

X  YY  ■  cost  from  process  noise  during  BPT 

X  PYY  ■  partials  YY  wrt  theta  {row  of  scalers} 

X  All  used  as  accumulators  for  intermediate  results  during  recursions. 


X  DECLARE  VARIABLES  SO  STUFF  TO  BE  CLEARED  WILL  BE  AT  END 

Psi"eye(nx) ;  PsiDot«zeros(nx,nvar*nx) ; 

XX-zeros (nx) ;  PXX»zeroa (rue  ,nvar*nx) ; 

YYaO ;  PYY«zeros (nvar , 1 ) ; 

WW-zeros (nx) ;  PWV»zeros (nx , nvar*nx) ; 

i*0 ; j  «0 ; inx»0 ; j  nx«0 ; ir«0 ; iro*0  j ic»0 ; ico*0 ; ispax«0 ; 
t2«0 ; of f set«0 ; dt“0 ; at«zeros(t2go) ; ssel«0 ; 


X  INITIALIZE  FOR  FIRST  EVENT 

doneal;  elaptiae»0;  X  time  into  BTP 

zerotol*BTP*epa ; 

[tl,U>min(t2go);  X  time  to  first  event 

iap»-eptr(ii,spindx(il));  X  identify  first  etm 

X  QUICKIE  INITIAL  DISCRETE  EVENT  IF  PRACTICAL 

if  isp>0,  X  first  event  discrete 

blksel*iep*nx*offcols; 

Psi«DS(:, bikeel); 

varsel-f ind((vptr( : , l)«aisp) * ) ; 

for  i*vareel,  PsiDot(vptr(i,2),(i-l)enx*vptr(i,3))«i;  end; 
spindx(il)«spindx(ii)*l ; 
fprintf (*D*) ;  fprintf (int2etr(isp)) ; 

end;  X  if  ispX) 


X  MAIN  STATE  TRANSITION  MATRIX  (eta)  CALCULATION  LOOP 

while  done>0,  X  main  loop  for  Psi  calcs 

if  («laptioe*tl*2erotol)>*BTP, tl-8TP-elaptiae;done»0;  end;  X  lest  step 
spindxaspindx- (apindx>eeqlen) eseqlen;  X  fix  possible  wrap-around 
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if  tl<»0,  X  tl»0  ■>  do  next  event  now 

st«sort(t2go) ;  X  find  next  event  time  too 

t2**st(2) ;  X  time  to  second  event 

if  (il«"fastseq)*(t2>"trainlen)k(spindx(il)"«l)k. . . 

((trainlen+elaptime)<BTP) ,  X  next  event  is  a  train 

X  TRAIN  EVENT 

rowsel»cols;  ssel"l;  dt"trainlen;  X  use  short  train  indices 

if  (t2>»(dt+speriod))i((dt+elaptime+speriod)<BTP) ,  X  k  cycles 
rowsal“rowsel+nx ;  ssel*2;  dt=dt+speriod;X  use  long  train  indices 
end; 

stm"tt(rowsel, :) ; 

YY»YY+sum(sum(XX.*qq(rowsel, :)  ))+ss(ssel) ; 
qtemp»Psi * *qq(rowsel , : ) ; 

for  i*varindx,  blksel*i*nx+of fools ;  X  for  all  variables 

qqdot«qtemp*PsiDot(: .blksel) ; 

PWW(: , blksel) »PWV(: , blksel) *qqdot+qqdot* ; 
PYY(i)“PYY(i)+sum(aum(PXX(: .blksel) .*qq(rowsel, :)  )) ; 

PXX(: .blksel) «PXX (; , blksel) *stm* ; 
end;  X  for  i»varindx 
PsiDot"stm*PsiDot; 

PXX«stm*PXX; 

OldX-XX; 

XX-stmeXX; 

for  i«l:nvart,  X  for  wars  in  train 

j"tvar(i);  blksel" jenx+off cols;  troblk«i*nx+of f cols ; 

PW«(: ,  blksel )  "PUN  ( : ,  blksel)  ♦Pei  •  *pqq (rowael ,  tmblk)  *Psi ; 
PYY(j)"PYV(j)-»suB(sum(  01dX.*pqq(rowqel,trnblk)  ))epsB(asel,i); 
PsiDot(: , blksel) "PsiDotC: ,blkael)>ptt(rowsel,trnblk)*Psi  ; 
rrdot"XX*ptt(rowsel,tmblk) 1 ; 

PXX(: , blksel ) *PXX ( ; , blksel) *rrdot+rrdot ' +prr (rousel , trnblk) ; 
end;  X  for  i"tvar 
WV«WV*qtemp*Psi ; 

Psi«8tm*Psi; 

XX"XX«8tm’ ♦rr(rowsel , : ) ; 

fprintf (*T*) ;  fprintf (int2str(sael)) ; 

t2go*t2go-dt; 

elaptime»elaptime+dt; 

t2go(il)"tl; 

else,  X  next  event  NOT  A  TRAIN  EVENT 

isp»-sptr(il,apindx(ii));  X  event  identifier 

if  isp>0.  X  iap  points  to  DS  block 

X  DISCRETE  EVENT 

blkael"i8p*nx«cffcols; 
roweel«find(any(DS(: .blksel) '-eye(nx))); 

if  lengtb(rovfel)<l,  rovael*l;  end;  X  guard  for  rovsel*eye 
ettt"DS(rowsel , blksel) ; 

PeiDot (rowsel . : )«stm*PeiDot; 

PXX(row*el, :)*sta*PXX; 
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for  i=varindx;  X  for  all  variables 

inx*(i-l)*nx;  blksel* inx+cols;  colsel»inx+rowael; 

PXX(: ,colsel)*PXX(: .blksel) *sta* ; 
end;  X  for  i*varindx 
XX (rows el , : ) =atm*XX; 
varsel=find((vptr(: ,l)==isp) ’) ; 

for  i*varsel,  inx»(i-l)*nx;  X  variables  in  DS  block 

blksel*inx+cola;  ir=vptr(i,2) ;  ic=vptr(i,3) ;  iro»inx+ir; 
PaiDot(ir,blksel)*PsiDot(ir,blksel)+Psi(ic, :) ; 

PXX ( : , iro ) =PXX ( : , iro) +XX ( : , ic) ; 

PXX (ir , blksel ) =PXX ( ir , blksel) +XX ( : ,ic) * ; 
end;  X  for  i* vara el 
Psi (rowsel , : )=stm*Pai ; 

XX(:  .rowseD^XX+stm* ; 

XXCrowsel , rowsel) -XX (rowsel , rowsel) +x0 (rouael , rowsel) ; 
fprintf (*D*) ;  fprintf (int2str(isp)) ; 

else,  X  isp  must  be  <  0  X  i.e.  continuous  segment 

t2go(il)*t2go(il)-iap;  X  increase  that  t2go  element 

fprintf (*/') » 

end;  Xif  iap>0  ...  else  ... 
end;  X  if  (il*»faataeq  ...  else  .. 

apindx(il)*apindx(il)+l;  X  increment  sequence  index 

else,  X  if  (tl<*  0)  i.e.  tl>0  *>  time  passes,  continuous  segment 

X  CONTINUOUS  TIKE  TRANSITIONS 

ABtl-ABni; 

Ati*A8tl (phirows .phirowa) $ 

tempwq*  C" ABt 1 1 ,  wO (phicolo , phicols ) *t 1 ; zeros ( ABuide) ,  ABtl] ; 
teapxr* [- Atl , xO (phirows , phirows )  *t  1 ; zeros  <nxc) ,  Atl’]; 
if  nargout>6  t  length(cversel)>0, 

ABdot*zeroa(ABwlde) ;  i*cvarael(l) ;  ABdot(vptr(i,2) ,vptr(i,3))*tl; 
tempwq* [tempvq, [zeros (ABuide) ; ABdot] ; zeros (ABuide, 2* ABuide) , ABtl] ; 
tempxr* [tempxr, Czeros(nxc) ; ABdot {phirows, phirows)] ; . . . 

zeros (nxc , 2*nxc) , Atl] ; 
end;  X  if  nargout>6  k  leagth(cvarael)X) 
tomp«q*oxpa(toaptfq) ; 
tempxr*expa(tempxr) ; 
phix*tempwq(w2cols , w2cols) ; 
phi-phi* (phirows ,:); 

Qtl*vQ*tl; 

Qtl (phicols, phicols) •phix,etempuq(phicols*u2cols); 
qteap*Psi’*Qtl; 

YY*YY*sum(sua(XX.*Qtl)) ; 

Rt 1  *phi ( : , phirows ) •tempxr (phi rows , x2cola ) ; 
inx*0; 

for  i*varindx; 
blksel* inx+cols; 
inx*inx+nx; 
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qqdot  =»qt  amp*  Ps  i  Do  t  ( : .blksal) ; 

PWW(: , blksal) "PWW ( : , blksal) +qqdot+qqdot ’ ; 

PYY(i)»PYY(i)+aum(sum(PXX(: .blksal) .*Qtl)) ; 

PXX(: ,inx+offprow8)*PXX(: .inx+offpcolo^phi* ; 
and;  X  for  i»varindx 
XX (phirova, :)=phi*XX (phicola, :) ; 

PaiDot(phiro«,  :)"phi*PsiDot(phicols, :) ; 

PXX (phirows , : ) "phi*PXX (phicola , : ) ; 

for  j*l:length(cvarael) ,  X  cont.  vara,  (not  tested) 

jj«cvarsel(j) ; 
inx»block(jj) ; 
blksel"inx+cols ; 
blkrow»inx+phirows ; 
blkcol"inx*phicols ; 
phidot-tempwq (phirova , v3cols) ; 

PaiDot (phirows ,blkaal)«PaiDot (phirows ,blkael)+phidot*Pai(phicols , :) ; 
rrdot-phi(: , phirows) **tempxr(pbirowa,x3cola) ; 
rrdot»rrdot+rrdot’ ; 

PXX (phi rows . blkrow) "PXX (phirova . blkrow) ♦rrdot ; 
rrdot"XX(: ,phicola)*phidot' ; 

PXX(: . blkrow) "PXX (: , blkrow) ♦rrdot; 

PXX (phirova , blksal )"PXX (phirova , blksal) ♦rrdot  * ; 
qqdot-phix ' *taBpwq (phicola , w3cola) ; 
qqdot"qqdot*qqdot  * ; 

PWW (phicola , blkcol ) "PWW (phicola , blkcol ) ♦qqdot ; 
if  jvl«ngth(cv%rsal); 

ABdot"zeros ( ABvide) ;  i"cvara«l(j+l) ; 

ABdot(vptr(i,2),vptr(i,3))"ti; 
te»pwq(v2colt , vicola) "ABdot ; 
taapxr(x2cola , x3cola)»ABdot (phirows .phirows) ; 
taapw0"axpa(t«ttpvq) ; 
t*ttpxr*e£p*(tetspxr) ; 
and;  X  if  j<l«Bgth(cvarael) 
and;  X  for  i«i:avar 
VW»VW*qtoap*Pai ; 

Pei (phirova , : )*phi*P$i (phicola , : ) ; 

XX(: ,pnirowa)«XX(: , phicola) *phi’; 

XX(phirowa,phirowa)»SX (phirova. phirovs)*Fttl; 
elapti«e»elaptitie+ti ; 
t2go«t2go-tl; 
fprintf (’€.*); 

and;  £  if  ti  <»0  . . .  alaa  . . . 

[tl,il]*ain(t2go);  %  next  event  ft  its  sequence 

end;  X  while  eiaptiaanKBTP  X  no  note  discretes  in  B7P 

X  Clear  large  temporary  arrays 

clear  qq;  clear  rr;  clear  as;  clear  tt; 

clear  pqq;  clear  prr;  clear  pas;  cleai*  ptt; 
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clear  phi; \ 
clear  tempv^; 
clear  phi ; 
clear  ABti; 
clear  rrdot; 
clear  blksel; 


clear  phidot 
clear  tempxr 
clear  phidot 
clear  Ati; 
clear  qtemp; 
clear  roesel 


clear  OldX 
clear  st; 
clear  stm; 
clear  Rtl; 
clear  qqdot; 
clear  trnblk 


clear  phiz; 
clear  Qtl; 

clear  varsel; 


if  nargout<5;  return;  end; 

£**********«**********EIui  of  Psi  ft  PaiDot  Calculation***************** 


X - - - Eigen  Calculations— — - - 

[P,Lam3»eig(Psi); 

Lam»diag(Lam) ;  X  convert  to  vector 

for  i*l:nx,  P(: ,i)®P(: ,i)/norm(P(; ,i)) ;  end;  X  normalize  eigenvectors 
fprintfO,  Eigs,  Partiala:  ’); 
if  nargout<7,  return,  end; 

1 - —Jacobian  Calculations - — — — — » — - — 

PLamazeroa(nx,nvar) ;  X  allocate  space  for  arrays 

PP®zoros(ax,nx*nvar) ; 
tempO*zeroa<nx,nx*nvar) ; 

altcol®0:nx; (»x*nvar-l);  X  column  offsets  for  nx  by  nx*nvar  arrays 

L“0;  omeg*0;  X  initialize  before  first  pass 

X  precompute  all  PsiDot*P(: ,i)  vectors 

colael«cols; 

tor  i*varindx,  teap0(: ,colsel)*PsiDot(: ,colsel)*P;  colaol-colsel*nx;  end; 

for  i«cols,  X  in^ex  to  eigenvalue/vector 

if  <i>l)ft(o»eg'«0)ft(conj (U»(l)  )®«L) ,  X  short  cut  for  conjugates 
PLa»(i*;)«conj(PLam<i-i, :)); 

PPC: ,altcol*i)«conj(PP(: ,*ltcol*i-i)>; 
else.  X  if  (i»l)ft(conj(Ua(i))*L)  X  normal  path 
colsel®i+altcol; 
p»P(:,i); 

L®Lam(i) ; 
ooeg»imag(L) ; 

X  precompute  templ«pinv(L*eye*(eye-p*p* j*Psi) 
templ-LeeyeCaxJ-Psi+peCp'ePui); 

CU.S,V3®svd(tempi) ; 

S«diag(S) ; 
tol«nx*S(i)*sp§; 
ir>sum(S>tol) ; 
rsel«l:ir; 

S®diag(one*(ir,l) ./S(rsel)) ; 
teapl*V<: ,rael)*S*U(: ,rssl) » ; 
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X  precompute  templ»pinv(L*eye+(eye-p+p’)*Psi)*(I-p*p>) 
templ^templ-^tempi*?)*?* ; 


X  compute  p.dot.ortho  and  store  in  ?P 
PP(: , colsel) =templ*tempQ(: ,  colsel) ; 

X  compute  lamdot  *  p’*PsiDot*p  +  p’*Psi*p..dot .ortho 
PLamCi, :)=p,*(tempO(: , colsel) +Psi*PP(: , colsel)) ; 


if  omeg'^O,  %  add  correction  to  p.dot.ortho  for  complex  EV’s 
sig=real(L) ; 

temp2=Psi*imag(p)-sig*imag(p)+omeg*real(p) ;  '/,  RHS  of  eqn  9 

[maxcompr , maxindx] =max (abs (temp2) ) ; 

maxcompratemp2 (maxindx) ;  X  biggest  component 

maxcompl»real (tempo (maxindx , colsel) ) ; 
maxcompl*maxcompl  -  real(PLam(i, :))*real(p (maxindx)) ; 
maxcompl-maxcompl  +  imag(PLam(i , : ) )*imag(p (maxindx) ) ; 
maxcomplamaxcompl+Psi (maxindx, :)*real(PP(: , colsel) ) ; 
marcompl=maxcompl  -  sig*real(PP (maxindx, colsel)) ; 
maxcompl-maxcompl  -omeg*imag(PP (maxindx, colsel)) ; 
gamma-sqrt (-1)* (maxcompl/maxcompr) ; 

PP(: ,colsel)*PP(: ,colsal)+p*gamma; 
end;  X  if  omeg'-O  . . .  else  . , . 
end;  X  if  (i>l)*(conj (Lam(i))a*Lam(i-l)) 
fprintf (int28tr(i)); 
end;  X  for  i*»i:nx 


X  true 


X  same 
X  component 
X  for  nvar 
X  LHS  eqns 

coefficient 
Dot  vectors 


X  something  to  watch 


fprintf (»  DONE.’); 

fprintf (*  SRp  Xg* , max (abs (Lam))  ); 

fprintf (’Sn*) ; 

return; 

X  end  of  function  psi.plus  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ 


y,*********************************************************************^* 


X 

X  OUTPUT:  Psi  ■  BTP  state  transition  matrix 
X  XX  »  E(xx')  at  BTP  start 

X  WW  -  BTP  weighting  matrix  at  BTP  start 

X  YY  ■  cost  correction  for  noise  in  current  BTP 

X  Lam  •  column  vector  of  Psi**  eigenvalues 

X  P  ■  matrix  of  Psi’s  unit  eigenvectors 

X  PXX  ■  partials  XX  (block  row)  wrt  theta 

X  PWW  «  partials  WW  (block  row)  wrt  theta 

X  PYY  ■  partials  YY  wrt  theta 

X  PLam  *  Jacobian  martix  (d  Lam  /  d  theta)  (nx  by  nvar) 

X  PP,  row  of  (d  P  /  d  theta)  block  matricies  (nx  by  nvar*nx) 

X  INPUT:  t2go  «  times  from  BTP  start  to  start  of  each  sequence  (>0). 


vu wv-ir u  n«r  *  \in  ua  hu'ila  aa  \ r-j l/avv srt n ajt  yvjl,*v it iv* ti.  k  n  jmm****  LPU'JVUi 
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X 

AB.DS,vptr,and  sptr:  (see  ’build. m’ 

and  ’ update. m’) 

X 

con:  (see  ’ 

check. m’ ) 

X 

zQ  =  process  noise  covariance 

X 

vO  «  static 

weighting  matrix 

X 

qq 

[  Wi  ;  W2  ] 

X 

rr  * 

[  XI  ;  X2  ] 

X 

ss  3 

C  Yi  ;  Y2  ] 

X 

tt  ■ 

[  Psii  ;  Psi2  ] 

X 

pqq 

[  Wi.dot.i 

Wi_dot_nvart  ; 

X 

W2_dot_l 

W2_dot_nvart  ] 

X 

prr  * 

[  Xl.dot.l 

Xl.dot.nvaxt  ; 

X 

X2_dot_l 

X2_dot_nvart  3 

X 

pss  ■ 

[  Yl.dot.l 

Yl.dot.nvart  ; 

X 

Yl_dot_2 

Y2.dot_nvart  ] 

X 

ptt  * 

[  Psii_dot.i 

Psil_dot_nvart  ; 

X 

Psi2.dot.l 

Psi2_dot_ nvart  j 

X 

X  Where  Pail,  Wl,  XI  and  Y1  apply  to  the  shorter  train  (k-1  periods), 

'/,  and  Psi2,  W2,  X2,  and  Y2  apply  to  the  longer  train  (k  periods). 

X  The  ’.dot.i’  notation  indicates  the  partial  with  respect  to  the  i’th 
X  variable  (theta  element)  in  the  fast  sequence  (nvart  such  variables) . 

X 

X*******************  STATE  TRANSITION  MATRIX  PARAMETERS***************)1* 

l 

X  These  parameters  are  defined  for  any  time  period: 

X  Psi  "State  Transition  Matrix  for  the  period 
X  PsiDot  ■  partial  of  Psi  wrt  a  variable  parameter  (theta  element) 

X  W  ®  weighting:  x(0)’W  x(0)  «  \integral_{period>  x(t)’W0  x(t)  dt 
X  W.dot  »  partial  of  W  wrt  a  variable  parameter  (theta  element) 

X  X  ■  E{x(f)x(f)’>  from  process  noise  (xO)  during  period  (if  x(0)«0) 

X  X.dot  ■  partial  of  X  wrt  a  variable  parameter  (theta  element) 

X  Y  »  E{\integral.{period>  x(t)*W0  x(t)  dt}  if  x(0)«0.  (scaler) 

X  Y.dot  ■  partial  Y  wrt  a  variable  parameter  (theta  element) 

X 

X  RECURSIVE  ALGORITHM  FOR  COMPUTING  SIM  PARAMETERS 
X  Suppose:  Psi(tf,tO)  ■  T(n)*T(n-l)*  ...  *T(2)*T(1),  where  T(i)  is 
X  the  state  transition  matrix  (etc)  for  the  i'th  segment  of  the  period. 

X  Let  Qu).R(i),  and  3(1)  represent  W,X,  and  ¥,  respectively,  for  T(i). 

X 

X  Initialise: 

X  Pai(0)»I,  PsiDot(0)*C0,0,...,0,03  These  may  be  considered 

X  W(0)«Q;  W_dot(0)*C0,0, . . . ,0,03  correct  values  for  Ti-I, 

X  X(0)»0;  X_dot(0)«CO,O . 0,03  a  null  transition  with 

X  Y(0)»0;  Y_dot(0)«[0,0, . . . ,0,03  zero  elapsed  time. 

X 

X  Recur 3 ions: 

X  Psi(i)-T(i)*Psi(i-i), 

X  PsiDot (i)*T(i)*PsiOot(i-i)*T.dot_(i)*Psi(i-i) , 
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W(i)*W(i-l)  +  Psi(i-l) ’*Q(i)*Psi(i-l) 

W_dot(i)=W_dot(i-l)  ♦  PsiDot(i-l) ’*Q(i)*Psi(i-l) . . . 

♦Psi(i-l) ’*Q_dot(i)*Psi(i-l)  +  Psi(i-l) ’*Qi*PsiDot(i-l) 
X(i)=T(i)*X(i-i)*T(i) *  +  R(i) 

X.dot(i)*T.dot(i)*X(i-i)*T(i) *  +  T(i)*X_dot(i-l)*T(i) * . . . 

+T(i)*X(i-l)*T_dot(i) ’  +  K„dot(i) 

Y(i)®Y(i-l)  +  X(i-l).*Q(i) 

Y_dot(i)»Y_dot(i-i)  +  X_<lot(i-l)  .*Q(i)  +  X(i-l) .*Q_dot(i) 

Then,  Psi(n),  PsiDot(n),  W(n),  W_dot(n),  X(n),  X.dot(n), 

Y(n)  and  Y.dot(n)  apply  to  the  period  covered  by  Psi. 

************************************************************* 

Train  concept:  The  fastest  sampler  has  frequent  bursts  or  trains  of 
k  or  k-1  consecutive  short  sample  periods  where: 

k®trunc(2’nd  shortest  sample  period/shortest  sample  period). 

Data  for  these  fixed  STM’s  are  precalculated  and  stored  in  ’trndat’ 
to  avoid  subsequent  reduce  redundant  calculations,  ’trndat*  includes 
the  discrete  events  on  both  ends  of  the  fast  ’sample  train.’ 

The  precalculated  trndat  and  cc  parameters  are  defined  as: 


qq 

■ 

C  Wl  ;  W2  ] 

rr 

■ 

C  XI  ;  X2  ] 

SB 

■ 

C  Yl  ;  Y2  ] 

tt 

■ 

C  Psil  ;  Psi2  ] 

pqq 

■ 

[  Wl.dot.l  ... 

Wl.dot.nvart  ; 

W2.dot.l  . . . 

W2_dot.nvart  ] 

prr 

• 

C  Xl.dot.l  . . . 

XI. dot. nvart  { 

X2_dot.l 

X2.dot.nvart  ] 

pss 

■ 

C  Yl.dot.l 

Yl.dot.nvart  j 

Yi„dot.2 

Y2.dot.nvart  j 

ptt 

m 

[  Psil.dot.l 

Psil.dot.nvart  ; 

Psi2.dot.l 

Psi2.dot.nvart  ] 

Where  Pail,  Wl,  XI  and  Yi  apply  to  the  shorter  train  (k-1  periods), 
and  Pai2,  W2,  X2,  and  Y2  apply  to  the  longer  train  (k  periods). 

The  ’.dot.i’  notation  indicates  the  partial  with  respect  to  the  i’th 
variable  (theta  element)  in  the  fast  sequence  (nvart  such  variables) . 

end  of  function  Psi.plus  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$*$$$$$$$$$$$$$ 


E.3.8  Precomputation  for  psi2plus:  trains2.m 

function  [QQ,Wl,SS,Tr,qQdot,IUWot,SSdot,TTdot>. . . 
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trains2 (vO.xO.AB.DS, seqptr , varptr , coasts , block , tvarsel , c varsel ) ; 

%  i ************************************************** 

X  **  This  version  is  limited  to  nseq»l  or  2  only.  ** 

•/,  ************************************************** 

X 

%  See  acstgrrt2.m  for  additional  comments  and  discussion 
f printf ( *  Train2:  step:  ’) ; 

nx»consts(i) ;  nxc»consts (2) ;  nxs»consts(3) ; 

nvar=consts(5) ;  nvarc*consts(6) ;  nseq=consts(7) ; 

seqlen»consts(8) ;  keyseq«consts(9) ;  fastseq»consts(ll) ; 

ABwide=nxc+nxs ;  cycles«round(consts(12)/consts(13)) ;  X  trainlen/speriod 
nvart*length(tvarsel) ;  nxv»nx*nvart; 

nvarct=sum (varptr (tvarsel , 1) *«0) ; 


X  indices  for  array  operations 

colsal:nx;  ccls2*cols+nx;  offcols*cols-nx; 

phirovs»l:nxc;  phi2rovB®phirova+nxc ;  phi3rovs»phi2rovs+nxc ; 

phicol8=»l :  ABwida ;  phi2cols«phicols+ABwide  ;  phi3cols«phi2cols+ABwide ; 

varindx»l:nvart; 


X  COMPUTE  PARAMETERS  FOR  ONE  CYCLE  OF  FASTSEQ. 


X  Put  first  event  in  train  data 

isp«-seqptr(f astseq, 1) ; 
blkl»isp*nx*off cols ; 
rovsell-f ind(any(DS(: .blkl) ’-eye(nx))) ; 

Q>zeros (nx) ;  Qdot«zeros (nx ,nxv) ; 

R»zeros (nx) ;  Rdot«zeros (nx ,nxv) ; 

S*0 ;  Sdot*zeros (i , nvart) ; 

T°DS( : ,blkl) ;  Tdot*zeros (nx , nxv) ; 

varsel l»f ind ( varptr( : ,  1) ' *»isp) ; 
for  i*varsell; 

ir*varptr(i,2) ;  ic* varptr ( i , 3 ) +block ( i ) j 

Tdot(ir,ic)"i; 
end;  %  for  i»varseli 
f printf (int2str(l>) ; 


X  initial  event  number 

X  non- identity  rows 
X  initial  U/Vdot 
X  initila  X/Xdot 
Xinitial  Y/Ydot 
X  initial  Psi/PsiDot 
X  variables  in  fastseq 
X  step  thru  fastseq  vars 
X  Tdot  rov/column 
X  Tdct(ir,ic)-i 

X  progress  display 


X  Include  rest  of  first  cycle  in  train  data 

for  j»2:seqlen; 

iap«-8eqptr(faatseq,j);  X  event  identifier 

if  isp>0,  X  isp  points  to  DS  block 

X  DISCRETE  EVENT 

blk*iop*nx+of fools;  X  index  to  DS 

rovsel“find(any(DS(: ,blk) '-eye(nx))) ;  X  non-identity  rows 


SfiSi 


E.3.  Design  Routines 


155 


X 


stm=DS (rowsel, blk) ; 

Tdot (rowsel, :)*stm*Tdot; 

R(rowsel , : )«stm*R; 

Rdot (rowsel , : )®stm*Rdot; 
for  i®varindx,  X  for 

inx=(i-i)*nx; 


X  new  stm 

X  PsiDot®stm*PsiDot 
X  X»stm*X 
X  Xdot»stm*Xdot 
all  Xdot  blocks 


Rdot( : , inx+rowsel)®Rdot ( : , inx+cols)*8tm* ;  X  Xdot® [atm* Xdot] ♦stm* 
end;  X  for  i=varindx 

varsel»find(isp»®varptr(:,l)*);  X  find  wars  in  stm 

for  i=varsel,  X  for  variables  in  stm,  add  Tdot  terms 

blk=block(i) +cols ; 


ir®varptr(i,2) ;  ic»varptr(i,3) ; 

Tdot(ir,blk)*Tdot(ir,blk)+T(ic, :) ;X  PBiDot»8tm*PsiDot+stmDot*Psi 
ico®block ( i) + ir ;  X  Xdot®stm*Xdot*stm*  +stm*X*stmdot * ♦stmdot*X*8tm, 
Rdot(: ,ico)®Rdot(: ,ico)+R(: ,ic) ;  . 

Rdot (ic, blk) *Rdot(ic, blk) ♦R(: ,ic)* ; 
end;  X  for  i=varsel 

T(rowsel, :)®stm*T;  X  Psi®stm*Psi 

R(:  .rowaeDaRestm* ;  X  X«[s1;m*X]*stm’  +  process  noise 

R (rowsel , rowael ) ®R (rowsel , rowael ) *x0 ( rowsel , rowsel ) ; 
else,  X  isp  must  be  <  0  X  continuous  time  only 

CONTINUOUS  TINE  TRANSITION 

tl—isp;  ABtl®AB*tl;  Atl®ABtl(phirova,phlrows) ; 
tempwquC-ABtl* ,sO(phicols ,phicols)*tl;zeros(ABwide) ,  ABtl] ; 
tempxv«[-Atl ,xO(phirows,phirows)*tl ;zeros(nxc) ,  Atl’] ; 
if  nvarc>0, 

ABdot®zero8 ( ABwide) ;  i®cvarsel ( 1 ) ; 

ABdot(varptr(i ,2) ,varptr(i,3))»tl ; 

tempwq* [teopvq , [zeros (ABwide) ;ABdot] ; zeros (ABwide, 2* ABwide) .ABtl] ; 
tempxr®[tempxr, [zeros (nxc) ; ABdot (phirows .phirows)] ; . . . 
zeros (nxc , 2*nxc) , Atl] ; 
end;  X  if  nvarc>0 


tempwq®expm(tempwq) ; 
tempxr-expm(tempxr) ; 

phix®tempwq(phi2cols ,phi2cols) j  X  phi  extended 

phi®phix (phirows, : ) ;  X  phi»[Phi(tl)  .Gama(tl)] ; 

Qtl«wO*ti;  X  Qtl®\integral.<0>-{tl>  B'exp(A't)  wO  exp(At)  B  dt 
Qtl(phicols,phicols)>phix*etempwq(phicols,phi2cols); 

X  Rtl«\integral_{0>“{tl>  exp(At)  xO  exp(A't)  dt 
Rtl®phi(: .phirows) * t empxr (phirows , phi2rows ) ; 

S®S*sua(sua(R.*qtl));  X  delta  cost  correct 

qtemp»T'*Qtl;  X  Psi'eq 

qqdot®qtemp*Tdot;  X  Psi'*q*PsiDot 

qdot®qdot+qqdot ;  X  Wdot«Wdot+Psi ' *q*PsiDot 

for  i®varindx;  X  column  operations 

inx*(i-l)*nx;  blk»inx*cols;  colael-inx+phicols ;  roweel®inx+phiroua ; 
X  Wdot-CWdot+Psi’eQePsiDotJ+PsiDot'eqePsi 
Qdot( : ,blk)®qdot ( : ,blk)+qqdot( : ,blk) ’ ; 
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Sdot(i)*Sdot(i)+sum(sum(Rdot(:  ,blk)  ,+Qol)) ; 

Rdot ( : ,  rowsel)  =Rdot ( : ,  colsel) *phi * ;  X  Xdot=Xdot*stm* 

end;  X  for  i»varindx 
01dR=R; 


X  X»stm*X 

X  Xdot=stm*  [Xdot*stm'  ] 


R (phirows, :)»phi*R(phiccls, :) ; 

Rdot (phirows , : )=phi*Rdoc (phicols , : ) ; 

Tdot (phirows , : ) =phi*l dot (phi cols , : ) ; 

X  INCLUDE:  T.dot,  q.dot,  and  R.dot  TERMS  (IF  ANY) 
for  j=l tnvarct,  X  cont.  vars.  (not  tested) 

i=min (find (c vars al  ( j  ) »tvarsel ) ) ; 
inx*block(cvarsel ( j)  ) ; 

blk3inx+cols;  rowsel=inx+phirows ;  colsel»inx+phicols ; 
phidot»tempwq(phirows,phi3cols) ;  X  T_dot 

Tdot (phirows ,blk)«Tdot (phirows , blk) +phidot*T (phicols , : ) ; 


X  R_dot 
X  Xdot+Rdot 
X  stm*X*stmDot ’ 


rtemp-phi ( : , phirows) *tempxr (phirows .phiSrows) ; 

Rdot (phirows , rowsel) «Rdot (phirows , rowsal) +rtemp ; 
rrdot»R( : , phicols) *phidot' ; 
ftdot(: , rowsel) *Rdct(: , rowsel) +rrdot; 

Rdot (phirows , blk) °Rdot (phirows , blk) +rrdot  * ; 
qqtemp»phix' *tempwq (phicols, phi3cols);  X  Q_dot 

Sdot(i)«Sdot(i)+sum(sum(01dR(phicols, phicols) ,*qqtemp)) ; 
tqdot»T ( : , phicols ) aqqtemp ; 

Qdot(: ,blk)»Qdot(: , blk) +tqdot*T (phicols, :) ; 
if  j<nvarc;  X  sot  up  next  cvar,  if  any 

ABdot*zeros(ABwide) ;  i«cvarsel(j*i) ; 
ABdot(varptr(i,2),varptr(i,3))«tl; 
terapwq(phi2cols ,phi3cols) -ABdot ; 
tenpxr (phi2rows , phi3rows ) -ABdot (phirows .phirows) ; 
tempvq-oxpm(tempvq) ; 
tempxr-expm(tempxr) ; 
end;  X  if  i"-cvarsel(0) 
end;  X  for  i-l:nvarc 

Q-Q+qtemp*T;  X 

T(phirows,:)-phi*T(phicols,:);  X 

R(: .phirows) -R(: .phicols) *phi’ ;  X 

R (phirows .phirows) -R(phirows , phirows )*Rtl;  X 
end;  X  if  isp>0  ...  else  ... 
f printf (int2str ( j ) ) ; 

end;  X  for  j-2:seqlen  X  no  more  discretes  in  speriod 


W»W+stm'*q*stm 

Psi-stm*Pai 

X»[stm*X]*stm’ 

X-CstmeXesta'3+R 


X  EXTEND  TO  'CYCLES'  ft  ‘CYCLES+l’  PERIODS  AND  ADD  FINAL  DISCRETE  EVENT 
f printf (’,  cycle:  '); 

Psi-T;  PsiDot-Tdot; 

X-R;  Xdot-Rdot ; 

W-q ;  Udotaqdot ; 

cc-S;  ccdot-Sdot ; 

stm«DS(rowsell ,blkl) ;  X  stm  for  final  event 

f printf (int2str(l) ) ; 
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loopcount- [cycles, 2] ;  %  set  number  of  loop  iterations 

for  case»i:2;  X  1:  first  cycles  periods;  2:  last  period 

of fcyc- (case-1) * (cycles- 1) ; 
for  i*2 : loopcount (case) , 
cc»cc+sum(sum(X . *Q) )+S ; 
qtemp-Psi’eQ; 
qqdot»qtemp*Ps iDot ; 
qqqdot-Psi *  *Qdot ; 

Wdot-Wdot+qqdot ; 

OldX-X; 

X=T*X; 

QldXdot-Xdot; 

Xdot»T*Xdot ; 

PsiDot»T*PsiDot ; 
for  j-varindx, 
jnx-(j-i)*nx;  blk-jnx+cols; 

Hdot(: ,blk)-Wdot(: ,blk)*qqdot(: ,blk) *+qqqdot(: ,blk)*Psi; 
ccdot(j)-ccdot(j)+sua(sum(01dXdot(: ,blk) .*Q. . . 

♦01dX.*Qdot(: ,blk)  ))+Sdot(j); 
rtemp=X*Tdot ( : ,blk) ’ ; 

Xdot(: ,blk)»Xdot(: ,blk)*T*  *  rtemp  ♦  rtemp'+Rdot(: ,blk) ; 
PsiDot(: ,blk)-PsiDot(: ,blk)+Tdot(; ,blk)*Psi; 
end;  X  for  j-varindx 
W»W*qtemp*Psi; 

Psi-T*Psi; 

X-X*T'+R; 

f printf (int2str(i+off eye) ) ; 
end; 

base-(case-l)*nx;  colsel-base+cols;  rovsel-base+rovsell; 

QQ (colsel , :)-W;  QQdot (colsel, :)-Wdot ; 

SS(case)-cc;  SSdot(case, :)-ccdot; 

RRCcolsel, :)■!;  RR(rovsel, :)«stm*X; 

RRdot(colsel, :)-Xdot;  RRdot(rowsel, :)-stm*Xdot; 

TTdot(colsel, : )-PoiDot;  TTdot(rowsel, : )-stm*PsiDot ; 
for  i-varindx,  inx-(i-l)*nx; 

RRdot (colsel , inx+rovsell ) -RRdot (colsel , inx+eols) *stn* ; 
end;  X  for  i-varindx 
for  i-varsell,  blk»block(i)*cols; 

ir-varptr(i,2) ;  ic-varptr(i,3) ;  iro-base+ir;  ico-block(i)+ir; 
TTdot(iro,blk)-TTdot(iro,blk)*Psi(ic, :) ; 

RRdot (colsel , ico) "RRdot (colsel , ico) +RR(colsel , ic) ; 

RRdot ( iro , blk) -RRdot (iro , blk) +RR(colsel ,ic) * ; 
end;  X  for  i-varsell 

TKcolsel,  :)-Psi;  TT(rovsel,  :)-sta*Psi; 

RR(colael,rovaell)-RR(colsel, :)*ata* ; 

RR(rowBel,rowsell)-RR(rowsel,row*ell)+xO(rousell,rowsell) ; 
f printf (»/*); 
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end;  X  for  case*l:2 
f printf ( * DONE .  \n  ’ ) ; 

X  end  of  function  trains2.m  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$*$$$$ 


E.3.9  STM  Only:  psi2.m 

function  [Psi , XX , WW , YY] - . . . 
psi2(t2go,AB,DS,sptr,con,xO,wO,qq,rr,ss,tt) ; 

7.  Compute  STM  and  related  matrices. 

X  See  function  psi2plus  for  detailed  explanation. 


X  UNPACK 

nx=con(l) ; 
nvar»con(S) ; 
seqlen»con(8) ; 
trainlen»con(12) ; 

X  CREATE 

cols"l:nx; 
phirows»l:nxc; 
phicolsM :  ABuide; 
offpcolB»phicola-nx; 

X  VERIFY 


CONSTANTS 

nxc*con(2) ;  nxsacon(3) ; 

nvarc*con(6) ;  naeq»con(7) ; 

BTP»con(iO);  fastseq»con(U) ; 

speriod*con(13) ;  ABwide»nxc+nxs ; 

INDICIES  FOR  ARRAY  OPERATIONS 
offcols»cols-nx;  varindx»l:nvar; 

x2colB"phirous+nxc ; 
w2cols»pfcicols*ABwide ; 
of f prows “phirowa-nx ; 
t2go  IN  RANGE 


if  length(t2go)*'»nseq,  srrmsg('Extra/»issing  phase  times.');  end; 
if  (any(t2go<0)) ,  errmsgC Negative  time  to  go  in  psi  plus.*);  end; 


X— ...... — - -set  Pointers  for  Initial  Discrete  Events - - — 

X  t2go(i)  will  be  the  time  from  BTP  start  to  the  first  discrete 
X  event  for  each  sequence.  ‘»ptr(i,spindx(i)) '  defines  the  event. 
dons»i;  spindx»ones(t2go)*seqlen;  lastst*p“zeroa(t2go) ; 
while  done>0;  X  completion  flag 

for  i<»l:naeq,last8tep(i)«sptr(i,spindx(i));end;  X  indox  to  last  event 


laststep*laststep.*(last,8tep>0); 
backstop* (las tstep<t2go) ; 
done*au»(backstep) ; 
t2go»t2go -backstop . elaatstep ; 
t2go*t2go . * (t2go>0) ;  1 

spindx-spindx-backstep ; 
apindx«spindx+seqlen*(spindx<l) ; 
end;  X  while  done>0 
spindx-spindx+1 ; 

spindx-epindx- (spindx>s«qlen) eseqlen; 


X  mask  discrete  events 
X  boolean 
X  0  if  done 
X  adjust  t2go 

X  eliminate  any  negative  times 
X  adjust  index 
X  fix  possible  wrap-around 

X  set  to  current  event 
X  fix  wrap-around 


X . Compute  Pei,  XX,  WU,  YY . 

X  Psi  «  psi,  the  state  transition  matrix  for  the  specified  t2go. 
X  XX  »  E  xx*  at  BTP  end  from  process  noise  during  BTP 
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X  WW  ®  matrix  s.t.  xO’*WW*xO  is  the  cost  for  xO  error  at  BTP  start 
X  YY  *  cost  from  process  noise  during  BPT 

X  All  used  as  accumulators  for  intermediate  results  during  recursions. 


X  INITIALIZE  FOR  FIRST  EVENT 

done»l;  elaptime*0; 

zerotol»BTP*eps ; 

Ctl,ii]*min(t2go) ; 
isp«-sptr(il<spindx(il)) ; 

XX»zeros (nx) ;  WW»zeros (nx) ;  YY«0;  Psi»eye(nx); 
X  QUICKIE  INITIAL  DISCRETE  EVENT 

if  isp>0, 

blksel«isp*nx*of f cols ; 

Psi=*DS(:  .blksel) ; 
spindx(il)*spindx(il)+l; 
end;  X  if  isp>0 


X  time  into  BTP 

X  time  to  first  event 
X  identify  first  stm 
X  initialize  outputs 
IF  PRACTICAL 
X  first  event  discrete 


X  MAIN  STATE  TRANSITION  MATRIX  (stm)  CALCULATION  LOOP 

while  done>0,  X  main  Psi  loop 

if  (alaptime+tl+zerotol)>=BTP,  ti»BTP-elaptime jdone'O ; end;  Xlast  step 
spindx*spindx-(spindx>seqlen)*seqlen;  X  fix  any  wrap-around 

if  tl<"0,  X  tl»0  »>next  event  now 

st«sort(t2go) ;  X  get  next  event  time  too 

t2»at(2);  X  time  to  second  event 

if  (il*"fastseq)»(t2>«trainlen)A(8pindx(il)«l)t. . . 

(Ctrainleneelaptime)<BTP),  X  next  event  is  a  train 

X  TRAIN  EVENT 


rovsel«cola;  sael*i;  dt»trainlen;  X  use  short  train  indices 

if  (t2>«(dt*apariod))t((dt*elaptima+8period)<BTP),  X  k  cycles 
rowael»rowsel*nx;  osel«2;  dt«dt+aperiod;X  use  long  train  indices 
end; 

8tttott(rowsel,:)i 

YY«YY*8ua(8um(XX.*qq(row8el, :)  )) ess (seel); 
qtemp-Pai ' *qq(rov«el , :); 

XX«stm*XX; 

UV*W«qtemp*Psi ; 

Pai»atm*Psi; 

XX“XX*Bta‘*rr(rowsel, :); 

t2go*t2go-dt; 

elapt ime«elapt ime+dt ; 

t2go(il)*ti; 

else.  X  next  event  NOT  A  TRAIN  EVENT 

isp— sptr(ii.spindxCii));  X  event  identifier 

if  isp>0,  X  isp  points  to  DS  block 

X  DISCRETE  EVENT 

blk8el«iap»nX*of f cols ; 
rowaal*find(any(DS(: .blkael) ’-eye(nx))) ; 
if  length(rowsel)<0,  rowael-l;  end;  X  guard  for  rowsel>eye 
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atmaDS(rovsel .blksel) ; 

XX(rowsel , :)»stm*XX; 

Psi (rowsel , : ) ■stm+Pai ; 

XX ( : , rowsel) ■XXestm* ; 

XX(rowsel ,rowsel)*XX (rowsel, rowsel)+xO(rowsel , rowsel) ; 
else,  X  isp  must  be  <  0  %  l.e.  continuous  segment 

t2go(il)*t2go(il)-iap;  X  increase  that  t2go  element 

end;  Xif  isp>0  . . .  else  . . . 
end;  X  if  (il»fastseq  . . .  else  . . 

spindx(il)aspindx(il)+l;  X  increment  sequence  index 

else,  X  if  (tl<*  0)  i.e.  tl>0  •>  time  passes,  continuous  segment 

X  CONTINUOUS  TIME  TRANSITIONS 

ABtl=AB*tl; 

Atl=ABtl (phirows , phirows) ; 

tempwq=[-ABtl* ,v0 (phicols ,phicols)*tl ; zeros (ABvide) ,  ABtl] ; 

tempxr- [- At 1 , xO (phirows , phirows) *ti ; zeros (nxc) ,  Atl’] ; 

tempwq»expm(tempvq) ; 

tempxr«expm(tempxr) ; 

phix"tempwq(w2cols ,w2cols) ; 

phi»phix (phirows , : ) ; 

qtl»uO*tl; 

Qtl (phicols , phicols) •phix‘*tempwq(phicola,v2cols) ; 
qtempHPsi'eQti; 

YY*YY+aum(su»(XX , *Qti ) ) ; 

Rtl-phi(: .phirows) *tempxr (phirows, x2cols) ; 

XX(phirows , : )«phi*XX (phicols , ; > ; 

WW»VW+qteop*Pai ; 

Psi (phi rows, :)«phi*Psi (phicols, :); 

XX(: .phirows) -XX (: ,phicola)*phi* ; 

XX (ph irowa , phirows ) "XX (phirows , phirows)  *Rt 1 ; 
elaptime«elaptiae*tl ; 
t2go*t2go-tl ; 

end;  X  if  tl  <*0  ...  else  ... 

Ctl,ii]«min(t2go) ;  X  next  event  ft  its  sequence 

end;  X  while  elaptime*tl<BTP  X  no  more  discretes  in  BTP 

X  end  function  pai2  eeeeeeeeee*eeeeeeeeeeeeeeeeee*eee*eeeee*eeeeeeeee 


£.3.10  Linear  Search:  linsrch2.m 

function  optstpa. . . 

Iinarch2 (dir , istep , icoit , btime , wO , xO , AB ,DS , itheta , ieqptr , varptr , conate) ; 

X  linsrch  finds  the  step  (in  the  specified  direction)  to  minimise  cost. 

X  icost  *  cost  with  alpha*0,  and  itheta+optstp*dir  *»>theta  for  min  cost 
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nx=consts(l) ; 

GoodEnuf».10; 

tol=ie-8*icost+eps*nx*nx*nx; 

zerostep*le-10; 

count=0 ; 

maxcount*30 ; 

gaia2*2/  ( 1+sqrt  (5) ) ; 

gaml*l-gam2; 

scopestep*5; 

istep"real(istep) ; 

optstp»istep; 


X  10  pet  convergence  tolerance 
X  minimum  cost  improvement 
X  threshold  for  effectively  zero  step 
X  iteration  counter 

X  Loop  quits  after  this  many  iterations 
X  golden  section  ratio  (.62  approx) 

%  golden  section  ratio  (.38  approx) 

X  factor  to  shrink/stretch  search  region 
X  make  sure  it's  real 
X  load  some  initial  value 


f printf ( *  linsrch2 : ’) ; 


X  Part  1:  find  region  containing  minimum  (assuming  cost  unimodal). 

alpha*zeros(4,i) ;  X  vector  of  step  sizes 

coat»zeros(4,l);  X  vector  of  corresponding  costs 

cost(l)*icoat; 
alpha(2)«istep; 

ttheta*itheta+alpha(2)*dir;  X  update  temporary  theta 

CAB , DS] "update (AB , DS , ttheta , varptr , coasts) ;  X  update  AB  k  D3 

cos t (2) -acat2 (bt iae , «0 , xO , AB , DS , seqptr , conats) ; 

alpha(3)*alpha(2) ; 

cost (3) -cost (2) j 

Xf printf ( '  linsrch2:  initial  and  point  •  Xg‘ .alpha (2))j 

Xf printf <*,  cost*  X3.5g  \n* .cost (2)); 

fprintf(»E*)j 

if  cost(2)<cost(l) ,  X  cost  still  decreasing 

case*l;  factor«acopestep;  ctrpt*2;  rtfend*3;  syab-'V ; 
else,  X  if  cost(4)<cost(l)  X  iotep  is  past  minimum 

case»2;  factor*l/scopestep;  ctrpt*3;  refend*l;  eyab»*<*; 
end; 


while  cost(ctrpt)>«cost(refend);  X  step  until  center  is  lower 

count»count»l; 

if  count >»«count,  optstp*-epa;  break;  end;  X  failure 
alpha(2)*alpha(3) ; 
cost (2) "cost (3); 

alpha(3)«alpha(2)*f actor;  X  new  alpha{3) 

tthota*itheta*alpha(3)*dir; 

CAB , DS] "update (AB , DS , ttheta , varptr « conats) ; 
cost (3) »acst2 (btias , wO , xO , AB , DS .ssqptr , const*) ; 
f printf (symb); 

XfprintfC  scoping:  alpha  *  Xg^alphaO)); 

Xf printf (*,  cost*  X3.5g  \n» .cost (3)); 
end;  X  while  coat (ctrpt)>*cost (refend) 
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if  optstp<=eps ;  return;  end;  '/,  error  return  #1 

best3*l:3;  %  three  beet  points 

temp4»ones(4,l)*cost(ctrpt) ;  X  best  cost  so  far 

X  Part  2:  guarded  parabolic/golden  section  search  for  minimum 

converr*l*max(co8t) ; 

while  converr>»(GoodEnuf*(icost-temp4(l))+tol) ,  X  converge  to  10  pet 
count*count+l ; 

if  count>maxcount,  optstp»-eps;  break;  end;  X  failure 
x*alpha(best3) ;  y=cost(best3) ; 

[x,xindx]»sort(x) ;  y*y(xindx);  X  put  alpha- ascending  order 

xspan*x(3)-x(l) ;  xc»(x(2)-x(l))/xspan; 

X**[l,  1;  xc*xc,  xc]; 

Y»C(y(3)-y(l));(y(2)-y<l))]; 

OX\Y;  X  approx:  y=C(l)*x''2+C(2)*x*y(l) 

xmin»-C(2)/(2*C(l)) ;  X  x  estimate  for  min  cost 

ymin»(C(l)*xmin*C(2))*xmin+y(l);  X  estimate  for  min  coat 

if  (2*x(2))>(x(l)+x(3)) ,  xgagaml;  else,  xg*gao2;  end; 

if  abs(xmia-xc)>aba(ss;g-xc) , 

newalpha»x(l)+xg*xspan;  case*l;  X  nee  alpha  if  golden  section 
else, 

neualpha*x(l)*xmia*xspaa;  ctae-2 ;  X  new  alpha  if  parabolic  fit 
end; 

alpha**  Ex ;  newalpha] ; 
ttheta»itheta+dir*newalpha; 

CAB , DS] -update (AB. OS , t theta , varptr, coneta) ; 
newcoa t»acat2 (bt iae , «0 , xO , AB , DS , aeqptr , conata) ; 
coat«[y;newcoat] ; 

[teapd, boat A] “sort (coat) ; 
beat3“beat4(l:3) ; 
coaverr*totap4(4)~teap4(i) ; 

If  caae“«2,  ce>abs (yidn-navcoat) ;  converr-ain(converr.ce) ; 

XfprintfO  inter? :  step*  O; 

fprintf('P’); 

elaa. 

XfprintfC  goldan:  step-  *); 

fpriatfC’G*); 

end; 

Xfpriatf (’X8.6f ,  coat-  Xl2.Se,  err«  Xl2.5e  \a* .alpha (4) , coat (4) .converr) ; 
end;  X  while  convergence  error  >  &  percent 
optatp»real(alpha(beat4(l))) ; 

Xfprlntf(‘  Final  coat»  X3.Sg,  final  »tep«  X3.5g  W ,te«p4(l),optstp); 
f printf ( *  Coat*  X7.5g,  etep“  X7.5g.\u' ,teap4(l) .optatp) ; 


return; 
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%  end  of  function  linsrch  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ 
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